Information processing system, information processing method, and program

Abstract

The purpose of the present disclosure is to make it possible for a user to easily ascertain where and on what kind of a photographic subject photography should be performed. An information processing system (1) according to the present disclosure comprises a storage unit (12) and a display unit (14). The storage unit (12) stores a space figure (A1) that is a figure of a subject space, a photography location (A2) that is set on the space figure (A1), and subject information (A31) that relates to a photographic subject to be photographed at the photography location (A2). The display unit (14) displays the space figure (A1), a marker corresponding to the photography location (A2), and the subject information (A31). The display unit (14), in an unphotographed state in which photography at the photography location (A2) is incomplete, displays the space figure (A1) such that a marker is superimposed onto a first display location corresponding to the photography location (A2) in the space figure (A1) and the subject information (A31) is superimposed onto a second display location corresponding to the first display location.

Description

Information processing system, information processing method, and program

[0001] The present disclosure relates to an information processing system, an information processing method, and a program. More specifically, the present disclosure relates to an information processing system, an information processing method, and a program that perform information processing related to image capture at an image capture position in a target space.

[0002] As a conventional example of technology for displaying a diagram of a target space and information about the shooting position on a display unit, the photographing terminal described in Patent Document 1 is exemplified. The photographing terminal displays a first screen that indicates the location where the equipment will be installed as a position on a layout diagram. When the first screen is displayed on the photographing terminal and the user selects (e.g., taps) a desired position on the first screen, the camera function of the photographing terminal is activated and a second screen is displayed on the photographing terminal. On the second screen, at least a portion of the construction information is displayed configurably on the screen (display unit) of the camera function. When the photographer takes a photograph using the camera function, the construction information linked to the position selected on the first screen is attached to the photographed image.

[0003] Although a user of the photographing terminal described in Patent Document 1 can determine the location where the device is installed from the first screen, there is a problem in that it is difficult to determine where and what kind of subject should be photographed.

[0004] Japanese Patent Application Laid-Open No. 2021-141388

[0005] An object of the present disclosure is to provide an information processing system, an information processing method, and a program that enable a user to easily understand where and what kind of subject should be photographed.

[0006] An information processing system according to one aspect of the present disclosure includes a storage unit and a display unit. The storage unit stores a space map that is a diagram of a target space, shooting positions set on the space map, and target information related to a target to be photographed at the shooting positions. The display unit displays the space map, markers corresponding to the shooting positions, and the target information. In an unphotographed state where photography at the shooting positions has not yet been completed, the display unit displays the space map with the marker superimposed at a first display position corresponding to the shooting position and the target information superimposed at a second display position corresponding to the first display position.

[0007] An information processing method according to one aspect of the present disclosure is an information processing method for an information processing system including a storage unit and a display unit, and includes a display step. The storage unit stores a space diagram that is a diagram of a target space, shooting positions set on the space diagram, and target information related to a target to be photographed at the shooting positions. The display unit displays the space diagram, markers corresponding to the shooting positions, and the target information. In the display step, in an unphotographed state where photography at the shooting positions has not yet been completed, the space diagram is displayed with the marker superimposed at a first display position corresponding to the shooting position and the target information superimposed at a second display position corresponding to the first display position.

[0008] A program according to one aspect of the present disclosure is a program for causing one or more processors of a computer system to execute the information processing method.

[0009] Fig. 1 is a block diagram of an information processing system according to an embodiment. Fig. 2 is a flowchart showing an example of processing in the information processing system. Fig. 3 is an explanatory diagram showing a first example of a screen display of the information processing system. Fig. 4 is an explanatory diagram showing a second example of a screen display of the information processing system. Fig. 5 is an explanatory diagram showing a third example of a screen display of the information processing system.

[0010] (Embodiments) An information processing system 1, an information processing method, and a program according to embodiments will be described below with reference to the drawings. However, the following embodiment is merely one of various embodiments of the present disclosure. The following embodiment can be modified in various ways depending on the design, etc., as long as the object of the present disclosure can be achieved.

[0011] (Summary) In the present disclosure, the "target space" refers to a construction site of a building (e.g., an apartment building, a detached house, an office building, a hospital, a factory, a commercial facility, etc.) before, during, or after construction. However, the "target space" is not limited to this example.

[0012] In construction work such as new construction, remodeling, or renovation of a building, a portion of the target space (construction site) of the building to be constructed is photographed, and the status of the building and the construction status are confirmed and inspected using the photographed images. The information processing system 1 presents information related to such photographing work to the worker (user) to assist in the confirmation and inspection of the status of the building and the construction status. In other words, the information processing system 1 assists in the confirmation and inspection associated with the construction of the building.

[0013] The information processing system 1 has a function of processing photographed images of a part of a target space of a building and information related to the photographed images in order to assist in confirmation and inspection associated with the construction of the building. Users such as workers and inspectors photograph parts of the target space before, during, or after construction and save the photographed images.

[0014] In this embodiment, as an example, the building is an apartment building, and a dwelling unit in the apartment building is being renovated. In this case, the target space is the dwelling unit (construction site) of the apartment building, which is the construction site for the renovation. When renovating a dwelling unit, a current situation survey is first conducted to confirm the condition of the dwelling unit before the renovation. Then, demolition work is carried out to remove unnecessary parts and equipment from the current dwelling unit, and the main renovation work is carried out. The main work includes carpentry work, equipment work, piping work, wiring work, painting work, interior work, etc. Once the main work is completed, a final inspection is carried out to inspect the dwelling unit after the renovation. During each of the current situation survey, demolition work, main work, and completion inspection, photography may be carried out to confirm and inspect the condition of the building and the construction status, etc.

[0015] As shown in FIG. 1, the information processing system 1 of this embodiment includes a storage unit 12 and a display unit 14. The storage unit 12 stores a space diagram A1, which is a diagram of a target space, a shooting position A2 set on the space diagram A1, and target information A31 related to the target to be photographed at the shooting position A2. As shown in FIG. 3, the display unit 14 displays the space diagram A1, markers (markers M1 to M4) corresponding to the shooting position A2, and target information A31. In an unphotographed state where photography at the shooting position A2 has not yet been completed, the display unit 14 displays the space diagram A1 with the markers (markers M1 to M4) superimposed at a first display position corresponding to the shooting position A2 on the space diagram A1 and the target information A31 superimposed at a second display position corresponding to the first display position.

[0016] Here, the space diagram A1 is a diagram representing the target space. The space diagram A1 may be, for example, a floor plan of the target space, or, if the target space is a dwelling unit, a floor plan of the dwelling unit. The space diagram A1 may be a two-dimensional drawing, a three-dimensional drawing, or a virtual image representing the target space. The shooting position A2 is a position where a shooting target existing in the target space is photographed by the shooting unit 15 (described later). The target information A31 is information about the shooting target to be photographed at the shooting position A2, and includes at least one of label information (such as a name) representing the shooting position where the shooting target is photographed and label information (such as a name) representing the shooting target. Note that, in the example screens shown in Figures 3 to 5, multiple shooting positions A2 are set on the space diagram A1, but the number of shooting positions A2 may be one or more and can be changed as appropriate. In Figures 3 to 5, four markers M1 to M4 representing four shooting positions A2 are displayed, respectively, but the number of markers can be changed as appropriate depending on the number of shooting positions A2. In the following description, the multiple markers M1 to M4 displayed superimposed on the spatial diagram A1 may be collectively referred to as markers Mn (n is a natural number).

[0017] Furthermore, the first display position corresponding to the shooting position A2 is, for example, the same position as the shooting position A2, but is not limited to a position that exactly coincides with the shooting position A2 and may be near the shooting position A2. Furthermore, the second display position is a position corresponding to the first display position, and therefore is also a position corresponding to the shooting position A2. The second display position is, for example, a position near the first display position. The second display position is set, for example, at a position where the marker Mn displayed at the first display position and the target information A31 displayed at the second display position are displayed adjacent to each other.

[0018] According to this embodiment, in an unphotographed state where photographing at photographing position A2 is not yet completed, the display unit 14 displays the spatial diagram A1 in which the markers Mn (M1 to M4) are superimposed at the first display position on the spatial diagram A1 and the target information A31 is superimposed at the second display position (see FIG. 3). Therefore, the user can easily grasp the photographing target and the photographing position A2 where the photographing target will be photographed based on the display content of the display unit 14, and can easily grasp where and what kind of target should be photographed.

[0019] Furthermore, functions similar to those of the information processing system 1 can be embodied in an information processing method. The information processing method of this embodiment is an information processing method executed by the information processing system 1 and includes a display step. The storage unit 12 stores a space diagram A1 that is a diagram of a target space, a shooting position A2 set on the space diagram A1, and target information A31 related to a target to be photographed at the shooting position A2. The display unit 14 displays the space diagram A1, a marker Mn corresponding to the shooting position A2, and the target information A31. In the display step, in an unphotographed state where photography at the shooting position A2 has not yet been completed, the space diagram A1 is displayed with the marker Mn superimposed at a first display position corresponding to the shooting position A2 on the space diagram A1 and the target information A31 superimposed at a second display position corresponding to the first display position.

[0020] The information processing method can be realized by a program. The program of this embodiment is a program for causing one or more processors of a computer system to execute the information processing method. The program may be recorded on a non-transitory recording medium readable by the computer system.

[0021] (Details) (1) Overall Configuration First, the overall configuration of an information processing system 1 will be described with reference to FIG.

[0022] The information processing system 1 is, for example, a tablet terminal, a smartphone, or a dedicated construction photo terminal used to take construction photos.

[0023] The information processing system 1 includes a computer system having one or more processors and a memory. At least some of the functions of the information processing system 1 are realized by the processor of the computer system executing a program recorded in the memory of the computer system. The program may be recorded in the memory, or may be provided via a telecommunications line such as the Internet, or may be provided by being recorded on a non-transitory recording medium such as a memory card.

[0024] As shown in FIG. 1 , the information processing system 1 includes a processing unit 11 , a storage unit 12 , an operation unit 13 , a display unit 14 , an image capturing unit 15 , and a communication unit 16 .

[0025] (2) Processing Unit The processing unit 11 includes one or more processors of the information processing system 1. The processing unit 11 executes a program to realize a predetermined function.

[0026] The processing unit 11 is configured to perform overall control of the information processing system 1. For example, the processing unit 11 controls the display of images by the display unit 14. The processing unit 11 also controls the photographing operation by the photographing unit 15.

[0027] The processing unit 11 may also have a function of performing image processing on the captured image A4 generated by the photographing unit 15. The image processing may include, for example, processing of combining an electronic whiteboard (electronic small blackboard) on which construction details are written with the captured image A4.

[0028] (3) Storage Unit The storage unit 12 stores information used in the information processing system 1. The storage unit 12 stores, for example, a space diagram A1, shooting positions A2, and display information A3. In this embodiment, a plurality of shooting positions A2 are set on the space diagram A1, and therefore the storage unit 12 stores the plurality of shooting positions A2. The display information A3 includes a plurality of pieces of object information A31 related to a plurality of shooting targets to be photographed at the plurality of shooting positions A2, and a plurality of pieces of order information A32.

[0029] The plurality of pieces of target information A31 correspond one-to-one to the plurality of shooting positions A2. Each piece of target information A31 includes information about the target to be photographed at the corresponding shooting position A2, such as label information for the shooting position A2 at which the target is photographed and label information for the target. The label information for the shooting position A2 at which the target is photographed includes, for example, information indicating the location of the shooting position A2. When the target space is a dwelling unit in an apartment building, the label information for the shooting position A2 preferably includes information indicating which room the shooting position A2 is. In FIG. 3 , the target information A31 displayed at the second display position includes, as label information for the shooting position A2, information such as whether the shooting position A2 is a Japanese-style room or a bathroom. Furthermore, the label information for the target preferably includes, for example, the name of the target. In FIG. 3 , the target information A31 displayed at the second display position includes, as label information for the target, information such as whether the target is a hook-on light or a recessed light. Note that the label information for the target may be a graphic symbol or the like representing the target.

[0030] The plurality of pieces of order information A32 correspond one-to-one to the plurality of photographing positions A2, and each piece of order information A32 indicates the order in which photographing is performed at the corresponding photographing position A2. That is, the storage unit 12 further stores the order information A32 indicating the order in which photographing is performed at the plurality of photographing positions A2.

[0031] The storage unit 12 also stores the photographed image A4 generated by the photographing unit 15. The storage unit 12 stores the photographed image A4 in association with information about the photographing position A2 at which the photographed image A4 was photographed.

[0032] The storage unit 12 preferably has a rewritable nonvolatile memory such as an EEPROM (Electrically Erasable Programmable Read Only Memory) or a flash memory.

[0033] (4) Operation Unit The operation unit 13 is a user interface device that accepts user operations. For example, the operation unit 13 includes at least one of a touch panel, a button, or a key switch that accepts user operations by hand (manual operations), and a microphone that accepts user operations by voice (voice operations).

[0034] When the operation unit 13 receives a user operation, it outputs an operation signal corresponding to the user operation to the processing unit 11. The processing unit 11 performs processing corresponding to the operation signal. For example, the processing unit 11 controls the display unit 14 or the imaging unit 15 in response to the operation signal.

[0035] When the operation unit 13 has a touch panel that accepts manual operations, user operations on the touch panel include, for example, tapping, double tapping, long tapping, dragging, swiping, flicking, pinching in, and pinching out.

[0036] If the operation unit 13 has a microphone that accepts voice operations, the operation unit 13 performs voice recognition processing on the output of the microphone to generate an operation signal corresponding to the voice uttered by the user. Note that the processing unit 11 may also perform the voice recognition processing.

[0037] (5) Image Capturing Unit The image capturing unit 15 includes a two-dimensional image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor. The image capturing unit 15 functions as a camera that captures color or monochrome images (still images) and generates data of the captured image A4. The image capturing unit 15 stores the data of the captured image A4 in the storage unit 12.

[0038] For example, if the touch panel display realizes the functions of both the operation unit 13 and the display unit 14, when the user taps a marker Mn displayed on the screen of the display unit 14, the image capture unit 15 enters a standby state for capturing an image. Furthermore, when the user performs a predetermined operation on the operation unit 13, the image capture unit 15 captures an image. The storage unit 12 stores data of the captured image A4 in association with information about the image capture position A2 corresponding to the marker Mn tapped by the user. Note that the display unit 14 displays the target information A31 at the second display position until an image is captured at the image capture position A2, and then displays the captured image A4 at the second display position once an image is captured at the image capture position A2.

[0039] (6) Communication Unit The communication unit 16 includes a communication interface device. The communication unit 16 is capable of communicating with an external system via the communication interface device. In this disclosure, "capable of communication" means being able to send and receive signals directly or indirectly via a network, a repeater, or the like, using an appropriate communication method such as wired communication or wireless communication. Note that wired communication refers to wired communication via, for example, a twisted pair cable, a dedicated communication line, or a LAN (Local Area Network) cable. Wireless communication refers to wireless communication that complies with standards such as Wi-Fi (registered trademark) or low-power wireless (specified low-power wireless) that does not require a license.

[0040] The communication unit 16 exchanges data with an external system. For example, the communication unit 16 acquires data of a space diagram A1 from an external system. For example, the communication unit 16 acquires data of the space diagram A1, which is a diagram of a target space, from an external CAD system or an external server, and stores the data of the space diagram A1 in the storage unit 12. Note that the space diagram A1 in this embodiment is a floor plan of a dwelling unit, as shown in Figures 3 to 5.

[0041] (7) Display Unit (7.1) Overview of the Display Unit The display unit 14 is a display device using an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diode), or the like, and has a screen for displaying images. The display unit 14 is controlled by the processing unit 11.

[0042] The touch panel display may also function as both the operation unit 13 and the display unit 14 .

[0043] When the subject is photographed at one or more photographing positions A2 set in the target space, the display unit 14 displays a space diagram A1 that is a diagram of the target space, as shown in FIGS.

[0044] Here, at least a first display area 141 that displays the spatial diagram A1 is provided on the screen of the display unit 14. In the example screens of Figures 3 to 5, the screen of the display unit 14 is further provided with a fourth display area 144 that displays a slide button SB1 for switching the display mode of the display unit 14 between a simple display mode and a detailed display mode.

[0045] 3 and 4 are examples of a screen when the display mode of the display unit 14 is the detailed display mode, and Fig. 5 is an example of a screen when the display mode of the display unit 14 is the simple display mode. Here, the simple display mode is a mode in which the display unit 14 displays a space diagram A1 with a marker Mn superimposed at a first display position corresponding to the shooting position A2. The detailed display mode is a mode in which the display unit 14 displays a space diagram A1 with the marker Mn superimposed at the first display position and with target information A31 or a photographed image A4 superimposed at a second display position corresponding to the first display position.

[0046] The fourth display area 144 displays a slide button SB1 for switching the detailed display mode between ON and OFF. Turning the detailed display mode ON means setting the display mode to the detailed display mode. Turning the detailed display mode OFF means setting the display mode to the simple display mode. When a user slides the slide button SB1 to the ON position, the operation unit 13 accepts a user operation to set the display mode to the detailed display mode. When a user slides the slide button SB1 to the OFF position, the operation unit 13 accepts a user operation to set the display mode to the simple display mode. In other words, the information processing system 1 further includes an operation unit 13 that accepts a user operation to switch the display mode of the display unit 14 between the simple display mode and the detailed display mode.

[0047] The following describes the display screen of the display unit 14 when the display mode is the detailed display mode and the display screen of the display unit 14 when the display mode is the simple display mode.

[0048] (7.2) Display Screen in Detail Display Mode The display screen when the display mode of the display unit 14 is the detail display mode will be described with reference to FIGS. 3 and 4. FIG.

[0049] FIG. 3 is an example of a display screen when photography has not been completed at all of the plurality of photography positions A2, and FIG. 4 is an example of a display screen when photography has been completed at all of the plurality of photography positions A2.

[0050] First, the display screen when photography has not been completed at all of the plurality of photography positions A2 will be described with reference to FIG.

[0051] The display unit 14 displays a space diagram A1, which is a diagram of the target space. The screen of the display unit 14 is provided with a first display area 141 for displaying the space diagram A1.

[0052] The display unit 14 displays a spatial diagram A1 in which multiple markers M1-M4 and multiple pieces of target information A31 are superimposed. The multiple markers M1-M4 correspond one-to-one to the multiple shooting positions A2. Each of the multiple markers M1-M4 is displayed at a first display position, which is the same position as the corresponding shooting position A2, and represents the location of the corresponding shooting position A2. The multiple pieces of target information A31 also correspond one-to-one to the multiple shooting positions A2. Each piece of target information A31 is displayed at a second display position corresponding to the first display position of the marker Mn representing the corresponding shooting position A2, and is displayed near the marker Mn representing the corresponding shooting position A2. In other words, the screen of the display unit 14 has a rectangular second display area 142 for displaying the target information A31 near the marker Mn. Characters representing the target information A31 (e.g., the name of the shooting position A2, the name of the subject being photographed, etc.) are displayed in this second display area 142.

[0053] Here, the second display area 142 displaying the target information A31 is smaller than the first display area 141 displaying the spatial diagram A1, and the second display area 142 is larger than the display size of the marker Mn. Because the second display area 142 is larger than the display size of the marker Mn, it is possible to increase the amount of target information displayed in the second display area 142. Furthermore, because the second display area 142 is smaller than the first display area 141, it is easier to see which of the multiple displayed markers M1 to M4 the target information A31 corresponds to, which has the advantage of allowing the user to easily grasp the shooting position A2 of the shooting target represented by the target information A31.

[0054] Moreover, order information A32 is displayed superimposed on each of the markers M1 to M4. In this embodiment, the order information A32 is represented by consecutive numbers such as 1, 2, 3, . . .

[0055] For example, at the first display position corresponding to the shooting position A2 where the first shooting will be performed, a marker M1 and the number [1] as the sequence information A32 are displayed superimposed on the spatial diagram A1, and at the second display position corresponding to the first display position, the target information A31 is displayed superimposed on the spatial diagram A1. Similarly, at the first display position corresponding to the shooting position A2 where the nth shooting will be performed (n is a natural number), a marker Mn and the number [n] as the sequence information A32 are displayed superimposed on the spatial diagram A1, and at the second display position corresponding to the first display position, the target information A31 is displayed superimposed on the spatial diagram A1.

[0056] In this way, when the display mode of the display unit 14 is the detailed display mode, the display unit 14 displays the space diagram A1 in which the marker Mn is superimposed at the first display position and the target information A31 is superimposed at the second display position in the pre-photographed state. Therefore, the user can easily understand, based on the display on the display unit 14, where and what kind of target to photograph.

[0057] The display unit 14 also displays the sequence information A32 in association with the marker Mn at each of the plurality of first display positions. Therefore, the user can easily understand the sequence in which to take photographs at the plurality of photographing positions A2 based on the display on the display unit 14.

[0058] In this embodiment, as shown in Fig. 3 etc., the display unit 14 displays the marker Mn and the sequence information A32 (numbers) so that they overlap each other. However, the sequence information A32 may be displayed near the marker Mn. In other words, the position where the marker Mn is displayed on the screen of the display unit 14 may be different from the position where the sequence information A32 is displayed.

[0059] Next, an example of a screen when photography is performed at all of the plurality of photography positions A2 will be described with reference to FIG.

[0060] The display unit 14 displays a space diagram A1, which is a diagram of a target space. The display unit 14 displays the space diagram A1 in which a plurality of markers M1 to M4 and a plurality of photographed images A4 are superimposed. The plurality of markers M1 to M4 correspond one-to-one to a plurality of photographing positions A2. Each of the plurality of markers M1 to M4 is displayed at a first display position, which is the same position as the corresponding photographing position A2, and represents the location of the corresponding photographing position A2. The plurality of photographed images A4 also correspond one-to-one to a plurality of photographing positions A2. Each of the plurality of photographed images A4 is displayed at a second display position corresponding to the first display position of the corresponding marker Mn, and is displayed near the corresponding marker Mn. Here, a rectangular third display area 143 for displaying the photographed image A4 is provided near the marker Mn on the screen of the display unit 14. The photographed image A4, which was captured of the photographing target at the corresponding photographing position A2, is displayed in this third display area 143. In this way, when the display mode of the display unit 14 is the detailed display mode, in a photographed state in which a photographed image A4 photographed at the photographing position A2 exists, the display unit 14 displays the space diagram A1 in which the marker Mn is superimposed at the first display position and the photographed image A4 is superimposed at the second display position. Therefore, since the photographed image A4 is displayed at the second display position, the user can easily understand that the photographing was performed at the photographing position A2 of the corresponding marker Mn.

[0061] Here, the third display area 143 displaying the captured image A4 is smaller than the first display area 141 displaying the spatial diagram A1, and the third display area 143 is larger than the display size of the marker Mn. Since the third display area 143 is larger than the display size of the marker Mn, it is possible to display a larger size of the captured image A4. Furthermore, because the third display area 143 is smaller than the first display area 141, it has the advantage of being easy to see which of the multiple markers Mn the captured image A4 corresponds to.

[0062] Note that Figure 4 shows an example screen when shooting has been completed at all of the multiple shooting positions A2, but when shooting has been completed at some of the multiple shooting positions A2, the multiple shooting positions A2 include unshooting positions where shooting has not yet been completed and shooting positions where shooting has been completed.

[0063] In this case, the display unit 14 displays a marker Mn at a first display position corresponding to an unphotographed position on the spatial diagram A1, and displays target information A31 related to the target to be photographed at the unphotographed position at a second display position corresponding to the first display position. Furthermore, the display unit 14 displays a marker Mn at a first display position corresponding to an already-photographed position on the spatial diagram A1, and displays a photographed image A4 photographed at the already-photographed position at a second display position corresponding to the first display position. This allows the user to check the photographed image A4 at the already-photographed position among the multiple photographing positions A2, and to check target information A31 related to the target to be photographed at the unphotographed position.

[0064] (7.3) Display Screen in Simple Display Mode The display screen when the display mode of the display unit 14 is the simple display mode will be described with reference to FIG.

[0065] The display unit 14 displays a space diagram A1, which is a diagram of the target space. The screen of the display unit 14 is provided with a first display area 141 for displaying the space diagram A1.

[0066] The display unit 14 displays a space diagram A1 in which multiple markers M1 to M4 are superimposed. The multiple markers M1 to M4 correspond one-to-one to the multiple shooting positions A2. Each of the multiple markers M1 to M4 is displayed at a first display position, which is the position of the corresponding shooting position A2, and represents the corresponding shooting position A2.

[0067] Thus, when the display mode of the display unit 14 is the simplified display mode, the display unit 14 displays the spatial diagram A1 with the markers M1 to M4 superimposed at the first display position. When the user sets the display mode of the display unit 14 to the simplified display mode, the display unit 14 displays the spatial diagram A1 with only the marker Mn representing the shooting position A2 superimposed, which has the advantage of simplifying the display on the display unit 14. In other words, in the simplified display mode, the target information is not displayed at the second display position corresponding to the first display position on the spatial diagram A1. Note that, when the display mode of the display unit 14 is the detailed display mode, the display unit 14 displays the spatial diagram A1 with the markers M1 to M4 superimposed at the first display position, and with the target information A31 superimposed at the second display position in the unphotographed state and the photographed image A4 superimposed at the second display position in the photographed state. This allows the user to easily identify the target and the shooting position A2 for photographing the target based on the target information A31 displayed at the second display position in the unphotographed state. Furthermore, in the already-photographed state, the user can easily check the photographed image A4 photographed at the photographing position A2 based on the photographed image A4 displayed at the second display position.

[0068] (8) Processing Flow Next, the processing flow of the information processing system 1 in the work of taking photos for construction confirmation will be described with reference to Fig. 2. Note that the flowchart shown in Fig. 2 is merely an example, and the order of each step may be changed as appropriate, and steps may be added or omitted as appropriate.

[0069] First, input information such as a space diagram A1, a plurality of shooting positions A2, and a plurality of pieces of display information A3 is input to the information processing system 1 (step ST1). The space diagram A1, the plurality of shooting positions A2, and the plurality of pieces of display information A3 are input to the communication unit 16 from, for example, an external system. Alternatively, the plurality of shooting positions A2 and the plurality of pieces of display information A3 are input by, for example, a user operating the operation unit 13.

[0070] The storage unit 12 stores the information input in step ST1.

[0071] When the necessary information is input in step ST1, the information processing system 1 starts a process of displaying the space diagram A1 on the display unit 14.

[0072] The processing unit 11 determines whether the display mode is the detailed display mode or the simple display mode based on the operation information received by the operation unit 13 (step ST2).

[0073] If the display mode is the detailed display mode (step ST2: Yes), the processing unit 11 determines one of the plurality of shooting positions A2 as the shooting position A2 to be determined, and determines whether the shooting position A2 to be determined is a position where an image has already been taken (step ST3). For example, the processing unit 11 determines the plurality of shooting positions A2 in order as the shooting position A2 to be determined according to the shooting order indicated by the order information A32, and determines whether the shooting position A2 to be determined is a position where an image has already been taken.

[0074] If photography at the photography position A2 to be determined has not been completed, the processing unit 11 determines that the photography position A2 to be determined is not a photography position (step ST3: No), and superimposes the target information A31 at the second display position corresponding to the photography position A2 to be determined in the spatial diagram A1 (step ST5).

[0075] If shooting at the shooting position A2 to be determined has been completed, the processing unit 11 determines that the shooting position A2 to be determined is a position where shooting has already been completed (step ST3: Yes), and superimposes the captured image A4 at the second display position corresponding to the shooting position A2 to be determined in the spatial diagram A1 (step ST4).

[0076] Next, the processing unit 11 determines whether or not the processing from steps ST3 to ST5 has been performed on all of the photographing positions A2 in the space diagram A1 as the photographing positions A2 to be determined (step ST6).

[0077] If there is a shooting position A2 that is not the target of the determination (step ST6: No), the processing unit 11 sets the next shooting position A2 in the shooting order as the shooting position A2 to be determined, and returns to step ST3 to repeat the above process.

[0078] If all the photographing positions A2 have been subjected to the determination (step ST6: Yes), the processing unit 11 places the marker Mn superimposed on the first display position in the space diagram A1 (step ST7).

[0079] Then, the processing unit 11 performs a display process to display on the display unit 14 the spatial diagram A1 in which the marker Mn is superimposed at the first display position and the target information A31 or the photographed image A4 is superimposed at the second display position (step ST8).

[0080] On the other hand, if the result of the determination in step ST2 is that the display mode is the simple display mode (step ST2: No), the processing unit 11 places the marker Mn superimposed on the first display position in the spatial diagram A1 (step ST7).Then, the processing unit 11 performs a display process to display the spatial diagram A1 with the marker Mn superimposed on the first display position on the display unit 14 (step ST8).

[0081] When the display unit 14 displays the spatial diagram A1, and the user taps the marker Mn (step ST9: Yes), the operation unit 13 accepts the operation information, and the processing unit 11 activates the photographing unit 15. After that, when the operation unit 13 accepts a predetermined operation, the photographing unit 15 photographs the subject (step ST10), and the photographed image A4 taken by the photographing unit 15 is stored in the storage unit 12, and the processing unit 11 returns to step ST2 to repeat the processes from step ST2 onwards.

[0082] As a result, when an image is captured by the image capturing unit 15 at any of the image capturing positions A2, the captured image A4 is displayed at the second display position corresponding to the image capturing position A2 at which the image was captured.

[0083] The information processing system 1 repeats the processing of steps ST2 to ST10 until the user operates the operation unit 13 to end the display on the display unit 14, and performs information processing on the image captured at the image capturing position A2.

[0084] (Modifications of the embodiment) Modifications of the embodiment are listed below. The following modifications may be realized in appropriate combination.

[0085] The shape of the marker Mn is not limited to a pin shape and may be any shape.

[0086] The order information A32 is not limited to numbers, and may be, for example, letters such as the alphabet, or figures. The order in which the photographs are taken may be represented by the color of the markers Mn. That is, the order information A32 may be indicated by the color of the markers Mn.

[0087] In addition, the display unit 14 may display a marker Mn representing a shooting position A2 where image shooting has not yet been completed and a marker Mn representing a shooting position A2 where image shooting has been completed in different display modes (e.g., color, shape, etc.).

[0088] The information processing system 1 or the information processing method according to the present disclosure includes a computer system. The computer system is primarily composed of a processor and memory as hardware. At least a portion of the functions of the information processing system 1 or the information processing method according to the present disclosure are realized by the processor executing a program stored in the memory of the computer system. The program may be pre-stored in the memory of the computer system, provided via a telecommunications line, or provided by being stored on a non-transitory recording medium readable by the computer system, such as a memory card, optical disk, or hard disk drive. The processor of the computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large-scale integrated circuit (LSI). The integrated circuits, such as ICs and LSIs, are referred to by different names depending on the degree of integration, and include integrated circuits called system LSIs, very large-scale integration (VLSI), or ultra-large-scale integration (ULSI). Furthermore, a field-programmable gate array (FPGA), which is programmed after the LSI is manufactured, or a logic device capable of reconfiguring the connections within the LSI or the circuit partitions within the LSI, can also be employed as a processor. Multiple electronic circuits may be integrated into a single chip or distributed across multiple chips. Multiple chips may be integrated into a single device or distributed across multiple devices. The computer system referred to here includes a microcontroller having one or more processors and one or more memories. Therefore, the microcontroller is also composed of one or more electronic circuits, including a semiconductor integrated circuit or a large-scale integrated circuit.

[0089] Furthermore, it is not essential for the information processing system 1 that multiple functions are integrated into one device, and multiple components of the information processing system 1 may be distributed across multiple devices. For example, a device including the image capturing unit 15 may be provided separately from a device including the display unit 14.

[0090] At least some of the functions of the information processing system 1, for example, the image processing function in the processing unit 11, may be realized by a server or the cloud (cloud computing), or the like.

[0091] (Summary) As described above, the information processing system (1) of the first aspect includes a storage unit (12) and a display unit (14). The storage unit (12) stores a spatial diagram (A1) that is a diagram of a target space, shooting positions (A2) set on the spatial diagram (A1), and target information (A31) related to a target to be photographed at the shooting position (A2). The display unit (14) displays the spatial diagram (A1), markers (Mn, M1 to M4) corresponding to the shooting positions (A2), and the target information (A31). In an unphotographed state in which photography at the shooting position (A2) is not yet completed, the display unit (14) displays the spatial diagram (A1) with the markers (Mn, M1 to M4) superimposed at a first display position corresponding to the shooting position (A2) on the spatial diagram (A1) and the target information (A31) superimposed at a second display position corresponding to the first display position.

[0092] According to this aspect, the user can easily understand where and what kind of subject should be photographed.

[0093] In the information processing system (1) of the second aspect, the second display area (142) displaying the target information (A31) is smaller than the first display area (141) displaying the spatial diagram (A1) in the first aspect, and the second display area (142) is larger than the display size of the markers (Mn, M1 to M4).

[0094] According to this aspect, by making the second display area (142) larger than the display size of the markers (Mn, M1 to M4), the amount of information that can be displayed in the second display area (142) can be increased.

[0095] In the information processing system (1) of the third aspect, in the first or second aspect, in a photographed state in which a photographed image (A4) photographed at the photographing position (A2) exists, the display unit (14) displays a spatial diagram (A1) in which markers (Mn, M1 to M4) are superimposed at the first display position and the photographed image (A4) is superimposed at the second display position.

[0096] According to this aspect, in the photographed state, the photographed image (A4) is displayed at the second display position, so that the user can check the photographed image (A4) photographed at the photographing position (A2).

[0097] In the information processing system (1) of the fourth aspect, the third display area (143) for displaying the captured image (A4) is smaller than the first display area (141) for displaying the spatial diagram (A1) in the third aspect, and the third display area (143) is larger than the display size of the markers (Mn, M1 to M4).

[0098] According to this aspect, by making the third display area (143) larger than the display size of the markers (Mn, M1 to M4), the image size of the captured image (A4) displayed in the third display area (143) can be increased.

[0099] In a fifth aspect of the information processing system (1), in any of the first to fourth aspects, a plurality of photographing positions (A2) are set on a spatial diagram (A1). The plurality of photographing positions (A2) include unphotographed positions where photographing has not yet been completed and photographed positions where photographing has been completed. The display unit (14) displays markers (Mn, M1 to M4) at the unphotographed positions on the spatial diagram (A1) by overlaying them at first display positions corresponding to the unphotographed positions, and displays object information (A31) related to the subject to be photographed at the unphotographed positions by overlaying it at a second display position corresponding to the first display position corresponding to the unphotographed positions. The display unit (14) displays markers (Mn, M1 to M4) at the photographed positions on the spatial diagram (A1) by overlaying them at first display positions corresponding to the photographed positions, and displays a photographed image (A4) photographed at the photographed position by overlaying it at a second display position corresponding to the first display position corresponding to the photographed position.

[0100] According to this aspect, at an unphotographed position on the spatial diagram (A1), markers (Mn, M1 to M4) are displayed superimposed at the first display position, and target information (A31) is displayed superimposed at the second display position, so that the user can easily understand where and what kind of target to photograph. Also, at an photographed position on the spatial diagram (A1), markers (Mn, M1 to M4) are displayed superimposed at the first display position, and the photographed image (A4) is displayed superimposed at the second display position, so that the user can check the photographed image (A4) taken at the photographed position.

[0101] In the information processing system (1) of the sixth aspect, in the fifth aspect, the storage unit (12) further stores sequence information (A32) indicating the sequence of photographing at the plurality of photographing positions (A2). The display unit (14) displays the sequence information (A32) in association with the markers (Mn, M1 to M4) at each of the plurality of first display positions.

[0102] According to this aspect, the user can easily understand the order in which to take photographs at the multiple photographing positions (A2).

[0103] The information processing system (1) of a seventh aspect is any one of the first to sixth aspects, further comprising an operation unit (13) that accepts a user's operation to switch the display mode of the display unit (14) between a simple display mode and a detailed display mode. When the display mode of the display unit (14) is the detailed display mode, the display unit (14) displays, in an unphotographed state, a space diagram (A1) with markers (Mn, M1 to M4) superimposed at a first display position and target information (A31) superimposed at a second display position. When the display mode of the display unit (14) is the simple display mode, the display unit (14) displays the space diagram (A1) with markers (Mn, M1 to M4) superimposed at the first display position.

[0104] According to this aspect, the user can switch the display mode of the display unit (14) between the simple display mode and the detailed display mode. In the detailed display mode, the user can easily understand where and what kind of subject to photograph based on the subject information (A31) displayed in the second display position.

[0105] In the information processing system (1) of the eighth aspect, in the seventh aspect, when the display mode of the display unit (14) is a detailed display mode, the display unit (14) displays a spatial diagram (A1) in which markers (Mn, M1 to M4) are superimposed at the first display position and the photographed image (A4) is superimposed at the second display position in a photographed state in which a photographed image (A4) taken at the photographing position (A2) exists.

[0106] According to this aspect, the user can switch the display mode of the display unit (14) between a simple display mode and a detailed display mode. In the detailed display mode, the user can check the captured image (A4) captured at the capturing position (A2) based on the captured image (A4) displayed at the second display position.

[0107] A ninth aspect of the information processing method is an information processing method for an information processing system (1) including a storage unit (12) and a display unit (14), and includes a display step. The storage unit (12) stores a space diagram (A1) that is a diagram of a target space, a shooting position (A2) set on the space diagram (A1), and target information (A31) related to a target to be photographed at the shooting position (A2). The display unit (14) displays the space diagram (A1), markers (Mn, M1 to M4) corresponding to the shooting position (A2), and the target information (A31). In the display step, in an unphotographed state where photography at the shooting position (A2) is not yet completed, the space diagram (A1) is displayed with the markers (Mn, M1 to M4) superimposed at a first display position corresponding to the shooting position (A2) and the target information (A31) superimposed at a second display position corresponding to the first display position.

[0108] According to this aspect, the user can easily understand where and what kind of subject should be photographed.

[0109] In a tenth aspect of the information processing method, in the ninth aspect, a plurality of photographing positions (A2) are set on a spatial diagram (A1), and the plurality of photographing positions (A2) include unphotographed positions where photographing has not yet been completed and photographed positions where photographing has been completed. In the display step, markers (Mn, M1 to M4) are superimposed at first display positions corresponding to the unphotographed positions on the spatial diagram (A1), and object information (A31) related to the object to be photographed at the unphotographed positions is superimposed and displayed at a second display position corresponding to the first display position corresponding to the unphotographed positions. In the display step, markers (Mn, M1 to M4) are superimposed at first display positions corresponding to the photographed positions on the spatial diagram (A1), and a photographed image (A4) photographed at the photographed position is superimposed and displayed at a second display position corresponding to the first display position corresponding to the photographed position.

[0110] According to this aspect, at an unphotographed position on the spatial diagram (A1), markers (Mn, M1 to M4) are displayed superimposed at the first display position, and target information (A31) is displayed superimposed at the second display position, so that the user can easily understand where and what kind of target to photograph. Also, at an photographed position on the spatial diagram (A1), markers (Mn, M1 to M4) are displayed superimposed at the first display position, and the photographed image (A4) is displayed superimposed at the second display position, so that the user can check the photographed image (A4) taken at the photographed position.

[0111] A program according to an eleventh aspect is a program for causing one or more processors of a computer system to execute the information processing method according to the ninth or tenth aspect.

[0112] According to this aspect, the user can easily understand where and what kind of subject should be photographed.

[0113] Not limited to the above aspects, various configurations (including modified examples) of the information processing system (1) according to the embodiment can be embodied as an information processing method performed by the information processing system (1), a (computer) program, or a non-transitory recording medium on which a program is recorded, etc.

[0114] The configurations according to the second to eighth aspects are not essential for the information processing system (1) and may be omitted as appropriate. The configuration according to the tenth aspect is not essential for the information processing method and may be omitted as appropriate.

[0115] 1 Information processing system 12 Storage unit 13 Operation unit 14 Display unit 141 First display area 142 Second display area 143 Third display area A1 Space diagram A2 Shooting position A4 Shooting image A31 Object information A32 Order information Mn, M1 to M4 Markers

Claims

1. A storage unit that stores a space map that is a diagram of a target space, a shooting position set on the space map, and target information related to a shooting target to be shot at the shooting position; a display unit that displays the spatial map, a marker corresponding to the shooting position, and the target information; In an uncaptured state where the image capturing at the image capturing position is not yet completed, the display unit displays the space diagram in which the marker is superimposed at a first display position corresponding to the image capturing position on the space diagram, and the target information is superimposed at a second display position corresponding to the first display position. Information processing system.

2. a second display area displaying the target information is smaller than a first display area displaying the spatial diagram, and the second display area is larger than a display size of the marker; The information processing system according to claim 1 .

3. The display unit, in a photographed state in which a photographed image photographed at the photographing position exists, displays the space diagram in which the marker is superimposed on the first display position and the photographed image is superimposed on the second display position. The information processing system according to claim 1 .

4. a third display area for displaying the captured image is smaller than a first display area for displaying the spatial diagram, and the third display area is larger than a display size of the marker; The information processing system according to claim 3 .

5. A plurality of the photographing positions are set on the spatial map, The plurality of shooting positions include an unshooting position where shooting has not been completed and a shooting position where shooting has been completed, The display unit is At the unphotographed position on the spatial diagram, the marker is superimposed on the first display position corresponding to the unphotographed position, and the target information regarding the photographed target to be photographed at the unphotographed position is superimposed on the second display position corresponding to the first display position corresponding to the unphotographed position, At the photographed position on the spatial diagram, the marker is superimposed on the first display position corresponding to the photographed position, and the photographed image photographed at the photographed position is superimposed on the second display position corresponding to the first display position corresponding to the photographed position. The information processing system according to claim 1 .

6. the storage unit further stores sequence information indicating a sequence of taking images at the plurality of shooting positions; the display unit displays the order information in association with the marker at each of the plurality of first display positions.

6. The information processing system according to claim 5.

7. an operation unit that receives a user's operation for switching a display mode of the display unit to either a simple display mode or a detailed display mode, When the display mode of the display unit is the detailed display mode, the display unit displays, in the uncaptured state, the space diagram in which the marker is superimposed on the first display position and the target information is superimposed on the second display position; When the display mode of the display unit is the simplified display mode, the display unit displays the space diagram with the marker superimposed on the first display position. The information processing system according to any one of claims 1 to 6.

8. When the display mode of the display unit is the detailed display mode, in a photographed state in which a photographed image photographed at the photographing position exists, the display unit displays the space diagram in which the marker is superimposed at the first display position and the photographed image is superimposed at the second display position. The information processing system according to claim 7.

9. A storage unit that stores a space map that is a diagram of a target space, a shooting position set on the space map, and target information related to a shooting target to be shot at the shooting position; An information processing method for an information processing system including a display unit that displays the spatial map, a marker corresponding to the shooting position, and the target information, a display step of displaying the space diagram in which, in an unphotographed state where the photographing at the photographing position is not yet completed, the marker is superimposed on a first display position corresponding to the photographing position in the space diagram, and the target information is superimposed on a second display position corresponding to the first display position, Information processing methods.

10. A plurality of the photographing positions are set on the spatial map, The plurality of shooting positions include an unshooting position where shooting has not been completed and a shooting position where shooting has been completed, In the display step, At the unphotographed position on the spatial diagram, the marker is superimposed on the first display position corresponding to the unphotographed position, and the target information regarding the photographed target to be photographed at the unphotographed position is superimposed on the second display position corresponding to the first display position corresponding to the unphotographed position, At the photographed position on the spatial diagram, the marker is superimposed on the first display position corresponding to the photographed position, and the photographed image photographed at the photographed position is superimposed on the second display position corresponding to the first display position corresponding to the photographed position. The information processing method according to claim 9.

11. 11. The information processing method according to claim 9 or 10, wherein the information processing method is executed by one or more processors of a computer system, program.