Information processing system, information processing method, and program

Abstract

The purpose of the present disclosure is to make it possible for a user to easily ascertain where and on what kind of a photographic subject photography should be performed. An information processing system (1) according to the present disclosure comprises a storage unit (12) and a display unit (14). The storage unit (12) stores a space figure (A1) that is a figure of a subject space, a photography location (A2) that is set on the space figure (A1), and subject information (A31) that relates to a photographic subject to be photographed at the photography location (A2). The display unit (14) displays the space figure (A1), a marker corresponding to the photography location (A2), and the subject information (A31). The display unit (14), in an unphotographed state in which photography at the photography location (A2) is incomplete, displays the space figure (A1) such that a marker is superimposed onto a first display location corresponding to the photography location (A2) in the space figure (A1) and the subject information (A31) is superimposed onto a second display location corresponding to the first display location.

Description

[Technical Field]

[0001] The present disclosure relates to an information processing system, an information processing method, and a program. More specifically, the present disclosure relates to an information processing system, an information processing method, and a program that perform information processing related to image capture at an image capture position in a target space. [Background technology]

[0002] The photographing terminal described in Patent Document 1 is exemplified as a conventional example of technology for displaying a diagram of a target space and information about the photographing position on a display unit. The photographing terminal displays a first screen that shows the location where the equipment will be installed as a position on a layout diagram. When the first screen is displayed on the photographing terminal and the user selects (e.g., taps) a desired position on the first screen, the camera function of the photographing terminal is activated and a second screen is displayed on the photographing terminal. At least a portion of the construction information is displayed configurably on the screen (display unit) of the camera function on the second screen. When the photographer takes a photograph using the camera function, the construction information linked to the position selected on the first screen is attached to the photographed image.

[0003] Although a user of the photographing terminal described in Patent Document 1 can determine the location where the device is installed from the first screen, there is a problem in that it is difficult to determine where and what kind of subject should be photographed. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-141388 Summary of the Invention

[0005] An object of the present disclosure is to provide an information processing system, an information processing method, and a program that enable a user to easily understand where and what kind of subject should be photographed.

[0006] An information processing system according to an embodiment of the present disclosure includes a storage unit, a display unit, and An operation unit; The storage unit stores a space map that is a diagram of a target space, shooting positions set on the space map, and target information related to a target to be photographed at the shooting positions. The display unit displays the space map, markers corresponding to the shooting positions, and the target information. The operation unit accepts a user's operation to switch the display mode of the display unit between a simple display mode and a detailed display mode. The display unit When the display mode of the display unit is the detailed display mode, In an unphotographed state where photography at the photography position has not yet been completed, the marker is superimposed on a first display position corresponding to the photography position in the space map, and the space map in which the target information is superimposed on a second display position corresponding to the first display position is displayed. When the display mode of the display unit is the simple display mode, the space diagram is displayed with the marker superimposed on the first display position.

[0007] An information processing method according to an aspect of the present disclosure is an information processing method for an information processing system including a storage unit and a display unit, the information processing method including a display step: , an operation acceptance step; The storage unit stores a space map that is a diagram of a target space, shooting positions set on the space map, and target information related to a target to be photographed at the shooting positions. The display unit displays the space map, markers corresponding to the shooting positions, and the target information. The operation accepting step accepts a user's operation to switch the display mode of the display unit to either a simple display mode or a detailed display mode. In the display step, When the display mode of the display unit is the detailed display mode, In an unphotographed state where photography at the photography position has not yet been completed, the marker is superimposed on a first display position corresponding to the photography position in the space map, and the space map in which the target information is superimposed on a second display position corresponding to the first display position is displayed. When the display mode of the display unit is the simple display mode, the space map is displayed with the marker superimposed on the first display position. do.

[0008] A program according to one aspect of the present disclosure is a program for causing one or more processors of a computer system to execute the information processing method. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram of an information processing system according to an embodiment. [Figure 2] FIG. 2 is a flowchart illustrating an example of processing in the information processing system. [Figure 3]FIG. 3 is an explanatory diagram showing a first example of a screen display of the information processing system. [Figure 4] FIG. 4 is an explanatory diagram showing a second example of a screen display of the information processing system. [Figure 5] FIG. 5 is an explanatory diagram showing a third example of a screen display of the information processing system. DETAILED DESCRIPTION OF THE INVENTION

[0010] (Embodiment) An information processing system 1, an information processing method, and a program according to an embodiment will be described below with reference to the accompanying drawings. However, the embodiment described below is merely one of various embodiments of the present disclosure. The embodiment described below can be modified in various ways depending on the design, etc., as long as the object of the present disclosure can be achieved.

[0011] (overview) The "target space" referred to in this disclosure is a construction site of a building (e.g., an apartment building, a detached house, an office building, a hospital, a factory, a commercial facility, etc.) before, during, or after construction. However, the "target space" is not limited to this example.

[0012] In construction work such as new construction, remodeling, or renovation of a building, a part of the target space (construction site) of the building to be constructed is photographed, and the status of the building and the construction status are confirmed and inspected using the photographed images. The information processing system 1 presents information related to such photographing work to the worker (user) to assist in the confirmation and inspection of the status of the building and the construction status. In other words, the information processing system 1 assists in the confirmation and inspection associated with the construction of the building.

[0013] The information processing system 1 has a function of processing photographed images of a part of the target space of a building and information related to the photographed images in order to assist in confirmation and inspection associated with the construction of the building. Users such as workers and inspectors photograph parts of the target space before, during, or after construction and save the photographed images.

[0014] In this embodiment, as an example, the building is an apartment building, and a dwelling unit in the apartment building is being renovated. In this case, the target space is the dwelling unit (construction site) of the apartment building, which is the construction site for the renovation. When renovating a dwelling unit, a current situation survey is first conducted to confirm the condition of the dwelling unit before the renovation. Then, demolition work is carried out to remove unnecessary parts and equipment from the current dwelling unit, and the main renovation work is carried out. The main work includes carpentry work, equipment work, piping work, wiring work, painting work, interior work, etc. Once the main work is completed, a final inspection is carried out to inspect the dwelling unit after the renovation. During each of the current situation survey, demolition work, main work, and completion inspection, photography may be carried out to confirm and inspect the condition of the building and the construction status, etc.

[0015] As shown in FIG. 1, the information processing system 1 of this embodiment includes a storage unit 12 and a display unit 14. The storage unit 12 stores a space map A1, which is a diagram of a target space, a shooting position A2 set on the space map A1, and target information A31 related to a target to be photographed at the shooting position A2. As shown in FIG. 3, the display unit 14 displays the space map A1, markers (markers M1 to M4) corresponding to the shooting position A2, and the target information A31. In an unphotographed state where photography at the shooting position A2 is not yet completed, the display unit 14 displays the space map A1 with the markers (markers M1 to M4) superimposed at a first display position corresponding to the shooting position A2 on the space map A1 and the target information A31 superimposed at a second display position corresponding to the first display position.

[0016] Here, the space diagram A1 is a diagram representing the target space. The space diagram A1 may be, for example, a floor plan of the target space, or if the target space is a dwelling unit, a floor plan of the dwelling unit. The space diagram A1 may be a two-dimensional drawing, a three-dimensional drawing, or a virtual image representing the target space. The shooting position A2 is a position where a shooting target existing in the target space is photographed by the shooting unit 15 (described later). The target information A31 is information about the shooting target to be photographed at the shooting position A2, and includes at least one of label information (such as a name) indicating the shooting position where the shooting target is photographed and label information (such as a name) representing the shooting target. Note that in the example screens shown in FIGS. 3 to 5, multiple shooting positions A2 are set on the space diagram A1, but the number of shooting positions A2 may be one or more and can be changed as appropriate. In FIGS. 3 to 5, four markers M1 to M4 representing four shooting positions A2, respectively, are displayed, but the number of markers can be changed as appropriate depending on the number of shooting positions A2. In the following description, the multiple markers M1 to M4 displayed in an overlapping manner on the space map A1 may be collectively referred to as markers Mn (n is a natural number).

[0017] Furthermore, the first display position corresponding to the photographing position A2 is, for example, the same position as the photographing position A2, but is not limited to a position that exactly coincides with the photographing position A2 and may be near the photographing position A2. Furthermore, the second display position is a position corresponding to the first display position, and therefore is also a position corresponding to the photographing position A2. The second display position is, for example, a position near the first display position. The second display position is set, for example, to a position where the marker Mn displayed at the first display position and the target information A31 displayed at the second display position are displayed adjacent to each other.

[0018] According to this embodiment, in an uncaptured state where image capture at image capture position A2 is not yet completed, the display unit 14 displays the space map A1 in which markers Mn (M1 to M4) are superimposed at the first display position in the space map A1 and object information A31 is superimposed at the second display position (see FIG. 3). Therefore, the user can easily grasp the object to be captured and the image capture position A2 where the object will be captured, based on the display content of the display unit 14, and can easily grasp where and what kind of object should be captured.

[0019] Furthermore, functions similar to those of the information processing system 1 can be embodied in an information processing method. The information processing method of this embodiment is an information processing method executed by the information processing system 1 and includes a display step. The storage unit 12 stores a space map A1 that is a diagram of a target space, a shooting position A2 set on the space map A1, and object information A31 related to an object to be photographed at the shooting position A2. The display unit 14 displays the space map A1, a marker Mn corresponding to the shooting position A2, and the object information A31. In the display step, in an unphotographed state where photography at the shooting position A2 is not yet completed, the space map A1 is displayed with the marker Mn superimposed at a first display position corresponding to the shooting position A2 in the space map A1 and the object information A31 superimposed at a second display position corresponding to the first display position.

[0020] The information processing method can be realized by a program. The program of this embodiment is a program for causing one or more processors of a computer system to execute the information processing method. The program may be recorded on a non-transitory recording medium readable by the computer system.

[0021] (detail) (1) Overall structure First, the overall configuration of an information processing system 1 will be described with reference to FIG.

[0022] The information processing system 1 is, for example, a tablet terminal, a smartphone, or a dedicated construction photo terminal used for taking construction photos.

[0023] The information processing system 1 includes a computer system having one or more processors and a memory. At least some of the functions of the information processing system 1 are realized by the processor of the computer system executing a program recorded in the memory of the computer system. The program may be recorded in the memory, or may be provided via a telecommunications line such as the Internet, or may be provided by recording it on a non-transitory recording medium such as a memory card.

[0024] As shown in FIG. 1, the information processing system 1 includes a processing unit 11, a storage unit 12, an operation unit 13, a display unit 14, an imaging unit 15, and a communication unit 16.

[0025] (2) Processing section The processing unit 11 includes one or more processors of the information processing system 1. The processing unit 11 executes a program to realize a predetermined function.

[0026] The processing unit 11 is configured to perform overall control of the information processing system 1. For example, the processing unit 11 controls the display of images by the display unit 14. The processing unit 11 also controls the photographing operation by the photographing unit 15.

[0027] The processing unit 11 may also have a function of performing image processing on the captured image A4 generated by the photographing unit 15. The image processing may include, for example, processing of combining an electronic blackboard (electronic small blackboard) on which construction details are written with the captured image A4.

[0028] (3) Storage section The storage unit 12 stores information used in the information processing system 1. The storage unit 12 stores, for example, a space map A1, shooting positions A2, and display information A3. In this embodiment, a plurality of shooting positions A2 are set on the space map A1, and therefore the storage unit 12 stores the plurality of shooting positions A2. The display information A3 includes a plurality of pieces of object information A31 relating to a plurality of shooting targets photographed at the plurality of shooting positions A2, and a plurality of pieces of order information A32.

[0029] The plurality of pieces of target information A31 correspond one-to-one to the plurality of shooting positions A2. Each of the plurality of pieces of target information A31 includes information about the target to be photographed at the corresponding shooting position A2, such as label information about the shooting position A2 at which the target is photographed and label information about the target. The label information about the shooting position A2 at which the target is photographed includes, for example, information indicating the location of the shooting position A2. When the target space is a dwelling unit in an apartment building, the label information about the shooting position A2 preferably includes information indicating which room the shooting position A2 is. In FIG. 3, the target information A31 displayed at the second display position includes, as label information about the shooting position A2, information such as whether the shooting position A2 is a Japanese-style room or a bathroom. The label information about the target preferably includes, for example, the name of the target. In FIG. 3, the target information A31 displayed at the second display position includes, as label information about the target, information such as whether the target is a hook-on light or a recessed light. The label information about the target may be a graphic symbol or the like representing the target.

[0030] Furthermore, the plurality of pieces of order information A32 correspond one-to-one to the plurality of photographing positions A2, and each of the plurality of pieces of order information A32 is information indicating the order in which photographing is performed at the corresponding photographing position A2. That is, the storage unit 12 further stores the order information A32 indicating the order in which photographing is performed at the plurality of photographing positions A2.

[0031] The storage unit 12 also stores the photographed image A4 generated by the photographing unit 15. The storage unit 12 stores the photographed image A4 in association with information about the photographing position A2 at which the photographed image A4 was photographed.

[0032] The storage unit 12 preferably has a rewritable nonvolatile memory such as an EEPROM (Electrically Erasable Programmable Read Only Memory) or a flash memory.

[0033] (4)Operation section The operation unit 13 is a user interface device that accepts user operations (user operations). For example, the operation unit 13 includes at least one of a touch panel, a button, a key switch that accepts user operations (manual operations), and a microphone that accepts user operations (voice operations) by voice.

[0034] When the operation unit 13 receives a user operation, it outputs an operation signal corresponding to the user operation to the processing unit 11. The processing unit 11 performs processing corresponding to the operation signal. For example, the processing unit 11 controls the display unit 14 or the imaging unit 15 in response to the operation signal.

[0035] When the operation unit 13 has a touch panel that accepts manual operations, user operations on the touch panel include, for example, tapping, double tapping, long tapping, dragging, swiping, flicking, pinching in, and pinching out.

[0036] If the operation unit 13 has a microphone that accepts voice operations, the operation unit 13 performs voice recognition processing on the output of the microphone to generate an operation signal corresponding to the voice uttered by the user. Note that the processing unit 11 may also perform the voice recognition processing.

[0037] (5) Filming Department The photographing unit 15 includes a two-dimensional image sensor such as a CCD (Charge Coupled Devices) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor. The photographing unit 15 functions as a camera that captures a color or monochrome image (still image) and generates data of the photographed image A4. The photographing unit 15 stores the data of the photographed image A4 in the storage unit 12.

[0038] For example, if a touch panel display realizes the functions of both the operation unit 13 and the display unit 14, when the user taps a marker Mn displayed on the screen of the display unit 14, the image capture unit 15 enters a standby state for capturing an image. Furthermore, when the user performs a predetermined operation on the operation unit 13, the image capture unit 15 captures an image. The storage unit 12 stores data of the captured image A4 in association with information about the capturing position A2 corresponding to the marker Mn tapped by the user. Note that the display unit 14 displays the target information A31 at the second display position until capturing an image at the capturing position A2, and displays the captured image A4 at the second display position once capturing an image at the capturing position A2.

[0039] (6) Communications Department The communication unit 16 includes a communication interface device. The communication unit 16 is capable of communicating with an external system via the communication interface device. In this disclosure, "capable of communication" means being able to send and receive signals directly or indirectly via a network or a repeater, etc., using an appropriate communication method such as wired communication or wireless communication. Note that wired communication refers to wired communication via, for example, a twisted pair cable, a dedicated communication line, or a LAN (Local Area Network) cable. Wireless communication refers to wireless communication that complies with standards such as Wi-Fi (registered trademark) or low-power wireless communication that does not require a license (specified low-power wireless).

[0040] The communication unit 16 exchanges data with an external system. For example, the communication unit 16 acquires data of a space diagram A1 from an external system. For example, the communication unit 16 acquires data of the space diagram A1, which is a diagram of a target space, from an external CAD system or an external server, and stores the data of the space diagram A1 in the storage unit 12. Note that the space diagram A1 in this embodiment is a floor plan of a dwelling unit, as shown in FIGS. 3 to 5.

[0041] (7)Display section (7.1) Display Overview The display unit 14 is a display device using an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diode), or the like, and has a screen for displaying images. The display unit 14 is controlled by the processing unit 11.

[0042] The touch panel display may function as both the operation unit 13 and the display unit 14.

[0043] When an object to be photographed is photographed at one or more photographing positions A2 set in the target space, the display unit 14 displays a space diagram A1 that is a diagram of the target space, as shown in FIGS.

[0044] Here, at least a first display area 141 that displays the spatial map A1 is provided on the screen of the display unit 14. In the screen examples of Figures 3 to 5, the screen of the display unit 14 is further provided with a fourth display area 144 that displays a slide button SB1 for switching the display mode of the display unit 14 between a simple display mode and a detailed display mode.

[0045] 3 and 4 are examples of a screen when the display mode of the display unit 14 is the detailed display mode, and Fig. 5 is an example of a screen when the display mode of the display unit 14 is the simple display mode. Here, the simple display mode is a mode in which the display unit 14 displays a space map A1 with a marker Mn superimposed at a first display position corresponding to the shooting position A2. The detailed display mode is a mode in which the display unit 14 displays a space map A1 with the marker Mn superimposed at the first display position and with target information A31 or a photographed image A4 superimposed at a second display position corresponding to the first display position.

[0046] A slide button SB1 for switching the detailed display mode between ON and OFF is displayed in the fourth display area 144. Turning the detailed display mode ON means setting the display mode to the detailed display mode. Turning the detailed display mode OFF means setting the display mode to the simple display mode. Here, when a user performs an operation of sliding the slide button SB1 to the ON position, the operation unit 13 accepts a user operation to set the display mode to the detailed display mode. Also, when a user performs an operation of sliding the slide button SB1 to the OFF position, the operation unit 13 accepts a user operation to set the display mode to the simple display mode. In other words, the information processing system 1 further includes an operation unit 13 that accepts a user operation to switch the display mode of the display unit 14 between the simple display mode and the detailed display mode.

[0047] The following describes the display screen of the display unit 14 when the display mode is the detailed display mode and the display screen of the display unit 14 when the display mode is the simple display mode.

[0048] (7.2) Display screen in detailed display mode The display screen when the display mode of the display unit 14 is the detailed display mode will be described with reference to FIGS.

[0049] FIG. 3 is an example of a display screen when photography has not been completed at all of the plurality of photography positions A2, and FIG. 4 is an example of a display screen when photography has been completed at all of the plurality of photography positions A2.

[0050] First, a display screen when photography has not been completed at all of the plurality of photography positions A2 will be described with reference to FIG.

[0051] The display unit 14 displays a space map A1, which is a diagram of the target space. The screen of the display unit 14 is provided with a first display area 141 for displaying the space map A1.

[0052] The display unit 14 displays a space map A1 in which multiple markers M1 to M4 and multiple pieces of target information A31 are superimposed. The multiple markers M1 to M4 correspond one-to-one to the multiple shooting positions A2. Each of the multiple markers M1 to M4 is displayed at a first display position, which is the same position as the corresponding shooting position A2, and represents the location of the corresponding shooting position A2. The multiple pieces of target information A31 also correspond one-to-one to the multiple shooting positions A2. Each piece of target information A31 is displayed at a second display position corresponding to the first display position of the marker Mn representing the corresponding shooting position A2, and is displayed near the marker Mn representing the corresponding shooting position A2. That is, the screen of the display unit 14 has a rectangular second display area 142 for displaying the target information A31 near the marker Mn. In this second display area 142, characters representing the target information A31 (e.g., the name of the shooting position A2, the name of the subject to be photographed, etc.) are displayed.

[0053] Here, the second display area 142 displaying the target information A31 is smaller than the first display area 141 displaying the spatial map A1, and the second display area 142 is larger than the display size of the marker Mn. Because the second display area 142 is larger than the display size of the marker Mn, it is possible to increase the amount of target information displayed in the second display area 142. Furthermore, because the second display area 142 is smaller than the first display area 141, it is easier to see which of the multiple displayed markers M1 to M4 the target information A31 corresponds to, which has the advantage of allowing the user to easily grasp the shooting position A2 of the shooting target represented by the target information A31.

[0054] Furthermore, sequence information A32 is displayed superimposed on each of the markers M1 to M4. In this embodiment, the sequence information A32 is represented by consecutive numbers such as 1, 2, 3, . . .

[0055] For example, at the first display position corresponding to the shooting position A2 where the first shooting will be performed, a marker M1 and the number [1] as the sequence information A32 are displayed superimposed on the space diagram A1, and at the second display position corresponding to the first display position, the object information A31 is displayed superimposed on the space diagram A1. Similarly, at the first display position corresponding to the shooting position A2 where the nth shooting will be performed (n is a natural number), a marker Mn and the number [n] as the sequence information A32 are displayed superimposed on the space diagram A1, and at the second display position corresponding to the first display position, the object information A31 is displayed superimposed on the space diagram A1.

[0056] In this way, when the display mode of the display unit 14 is the detailed display mode, the display unit 14 displays the space map A1 in which the marker Mn is superimposed at the first display position and the object information A31 is superimposed at the second display position in the pre-photographing state. Therefore, the user can easily understand, based on the display on the display unit 14, where and what kind of object should be photographed.

[0057] Furthermore, the display unit 14 displays the sequence information A32 in association with the marker Mn at each of the plurality of first display positions. Therefore, the user can easily understand the sequence in which to take photographs at the plurality of photographing positions A2 based on the display on the display unit 14.

[0058] In this embodiment, as shown in Fig. 3 etc., the display unit 14 displays the marker Mn and the sequence information A32 (numbers) so that they overlap each other. However, the sequence information A32 may be displayed near the marker Mn. In other words, the position where the marker Mn is displayed on the screen of the display unit 14 may be different from the position where the sequence information A32 is displayed.

[0059] Next, an example of a screen when photography is performed at all of the plurality of photography positions A2 will be described with reference to FIG.

[0060] The display unit 14 displays a space map A1, which is a diagram of a target space. The display unit 14 displays the space map A1 in which a plurality of markers M1 to M4 and a plurality of captured images A4 are superimposed. The plurality of markers M1 to M4 correspond one-to-one to a plurality of photographing positions A2. Each of the plurality of markers M1 to M4 is displayed at a first display position, which is the same position as the corresponding photographing position A2, and represents the location of the corresponding photographing position A2. The plurality of captured images A4 also correspond one-to-one to a plurality of photographing positions A2. Each of the plurality of captured images A4 is displayed at a second display position corresponding to the first display position of the corresponding marker Mn, and is displayed near the corresponding marker Mn. Here, a rectangular third display area 143 for displaying the captured image A4 is provided on the screen of the display unit 14 near the marker Mn. The captured image A4, which was captured of the photographing target at the corresponding photographing position A2, is displayed in this third display area 143. In this way, when the display mode of the display unit 14 is the detailed display mode, in a photographed state in which a photographed image A4 photographed at the photographing position A2 exists, the display unit 14 displays the space diagram A1 in which the marker Mn is superimposed at the first display position and the photographed image A4 is superimposed at the second display position. Therefore, since the photographed image A4 is displayed at the second display position, the user can easily understand that the photograph was taken at the photographing position A2 of the corresponding marker Mn.

[0061] Here, the third display area 143 displaying the captured image A4 is smaller than the first display area 141 displaying the spatial diagram A1, and the third display area 143 is larger than the display size of the marker Mn. Because the third display area 143 is larger than the display size of the marker Mn, it is possible to display a larger size of the captured image A4. Furthermore, because the third display area 143 is smaller than the first display area 141, there is also the advantage that it is easy to see which of the multiple markers Mn the captured image A4 corresponds to.

[0062] Note that Figure 4 shows an example screen when shooting has been completed at all of the multiple shooting positions A2, but when shooting has been completed at some of the multiple shooting positions A2, the multiple shooting positions A2 include unshooting positions where shooting has not been completed and shooting positions where shooting has been completed.

[0063] In this case, the display unit 14 displays a marker Mn at a first display position corresponding to the unphotographed position on the spatial map A1, and displays object information A31 related to the object to be photographed at the unphotographed position at a second display position corresponding to the first display position. Also, the display unit 14 displays a marker Mn at a photographed position on the spatial map A1 at a first display position corresponding to the photographed position, and displays a photographed image A4 photographed at the photographed position at a second display position corresponding to the first display position. This allows the user to check the photographed image A4 at the photographed position among the multiple photographing positions A2, and to check object information A31 of the object to be photographed at the unphotographed position.

[0064] (7.3) Display screen in simple display mode The display screen when the display mode of the display unit 14 is the simple display mode will be described with reference to FIG.

[0065] The display unit 14 displays a space map A1, which is a diagram of the target space. The screen of the display unit 14 is provided with a first display area 141 for displaying the space map A1.

[0066] The display unit 14 displays a space map A1 in which a plurality of markers M1 to M4 are superimposed. The plurality of markers M1 to M4 correspond one-to-one to a plurality of shooting positions A2. Each of the plurality of markers M1 to M4 is displayed at a first display position which is the position of the corresponding shooting position A2, and represents the corresponding shooting position A2.

[0067] Thus, when the display mode of the display unit 14 is the simple display mode, the display unit 14 displays a space map A1 with the markers M1 to M4 superimposed at the first display position. When the user sets the display mode of the display unit 14 to the simple display mode, the display unit 14 displays a space map A1 with only the marker Mn representing the shooting position A2 superimposed, which has the advantage of simplifying the display on the display unit 14. That is, in the simple display mode, the object information is not displayed at the second display position corresponding to the first display position in the space map A1. Note that when the display mode of the display unit 14 is the detailed display mode, the display unit 14 displays a space map A1 with the markers M1 to M4 superimposed at the first display position, and with the object information A31 superimposed at the second display position in the unphotographed state and with the photographed image A4 superimposed at the second display position in the photographed state. This allows the user to easily identify the object to be photographed and the photographing position A2 at which the object will be photographed, based on the object information A31 displayed at the second display position in the unphotographed state. Furthermore, in the already-photographed state, the user can easily check the photographed image A4 photographed at the photographing position A2 based on the photographed image A4 displayed at the second display position.

[0068] (8) Processing flow Next, the processing flow of the information processing system 1 in the work of taking photos for construction confirmation will be described with reference to Fig. 2. Note that the flowchart shown in Fig. 2 is merely an example, and the order of each step may be changed as appropriate, and steps may be added or omitted as appropriate.

[0069] First, input information such as a space map A1, a plurality of shooting positions A2, and a plurality of pieces of display information A3 is input to the information processing system 1 (step ST1). The space map A1, the plurality of shooting positions A2, and the plurality of pieces of display information A3 are input to the communication unit 16 from, for example, an external system. Alternatively, the plurality of shooting positions A2 and the plurality of pieces of display information A3 are input by, for example, a user operating the operation unit 13.

[0070] The storage unit 12 stores the information input in step ST1.

[0071] When the necessary information is input in step ST1, the information processing system 1 starts a process of displaying the space diagram A1 on the display unit .

[0072] The processing unit 11 determines whether the display mode is the detailed display mode or the simple display mode based on the operation information received by the operation unit 13 (step ST2).

[0073] If the result of the determination in step ST2 is that the display mode is the detailed display mode (step ST2: Yes), the processing unit 11 sets one of the multiple shooting positions A2 as the shooting position A2 to be determined, and determines whether the shooting position A2 to be determined is a position where an image has already been taken (step ST3). For example, the processing unit 11 sets the multiple shooting positions A2 as the shooting position A2 to be determined in order according to the shooting order represented by the order information A32, and determines whether the shooting position A2 to be determined is a position where an image has already been taken.

[0074] If the shooting at the shooting position A2 to be determined has not been completed, the processing unit 11 determines that the shooting position A2 to be determined is not a position where shooting has already been completed (step ST3: No), and places the target information A31 superimposed on the second display position corresponding to the shooting position A2 to be determined in the spatial diagram A1 (step ST5).

[0075] If the shooting at the shooting position A2 to be determined has been completed, the processing unit 11 determines that the shooting position A2 to be determined is a position where shooting has already been completed (step ST3: Yes), and superimposes the captured image A4 at the second display position corresponding to the shooting position A2 to be determined in the spatial diagram A1 (step ST4).

[0076] Next, the processing unit 11 determines whether or not the processing from steps ST3 to ST5 has been performed on all the shooting positions A2 in the space diagram A1 as shooting positions A2 to be determined (step ST6).

[0077] If there is a photographing position A2 that is not the subject of determination (step ST6: No), the processing unit 11 sets the next photographing position A2 in the photographing order as the photographing position A2 to be determined, and returns to step ST3 to repeat the above process.

[0078] If all the photographing positions A2 have been determined (step ST6: Yes), the processing unit 11 arranges the marker Mn so as to overlap the first display position in the space diagram A1 (step ST7).

[0079] Then, the processing unit 11 performs a display process to display on the display unit 14 the space map A1 in which the marker Mn is superimposed at the first display position and the target information A31 or the photographed image A4 is superimposed at the second display position (step ST8).

[0080] On the other hand, if the result of the determination in step ST2 is that the display mode is the simple display mode (step ST2: No), the processing unit 11 arranges the marker Mn superimposed on the first display position in the spatial map A1 (step ST7), and then performs display processing to display the spatial map A1 with the marker Mn superimposed on the first display position on the display unit 14 (step ST8).

[0081] When the display unit 14 is displaying the space diagram A1, and the user taps the marker Mn (step ST9: Yes), the operation unit 13 accepts the operation information, and the processing unit 11 starts the photographing unit 15. After that, when the operation unit 13 accepts a predetermined operation, the photographing unit 15 photographs the subject (step ST10), and the photographed image A4 taken by the photographing unit 15 is stored in the memory unit 12, and the processing unit 11 returns to step ST2 to repeat the processes from step ST2 onwards.

[0082] As a result, when an image is captured by the image capturing unit 15 at any of the image capturing positions A2, the captured image A4 is displayed at the second display position corresponding to the image capturing position A2 at which the image was captured.

[0083] The information processing system 1 repeats the processing of steps ST2 to ST10 until the user operates the operation unit 13 to end the display on the display unit 14, and performs information processing on the image captured at the image capturing position A2.

[0084] (Modification of the embodiment) Modifications of the embodiment are listed below. The following modifications may be implemented in appropriate combination.

[0085] The shape of the marker Mn is not limited to the shape of a pin, but may be any shape.

[0086] The order information A32 is not limited to numbers, and may be, for example, letters such as the alphabet, or figures. The order in which the images are taken may be represented by the color of the markers Mn. That is, the order information A32 may be indicated by the color of the markers Mn.

[0087] Furthermore, the display unit 14 may display the marker Mn representing the shooting position A2 where image shooting has not yet been completed and the marker Mn representing the shooting position A2 where image shooting has been completed in different display modes (for example, colors, shapes, etc.).

[0088] The information processing system 1 or the information processing method according to the present disclosure includes a computer system. The computer system is primarily composed of a processor and memory as hardware. At least a portion of the functions of the information processing system 1 or the information processing method according to the present disclosure are realized by the processor executing a program stored in the memory of the computer system. The program may be pre-stored in the memory of the computer system, provided via a telecommunications line, or provided on a non-transitory recording medium readable by the computer system, such as a memory card, optical disk, or hard disk drive. The processor of the computer system is composed of one or more electronic circuits, including a semiconductor integrated circuit (IC) or a large-scale integrated circuit (LSI). The integrated circuits, such as ICs and LSIs, are referred to by different names depending on the degree of integration, and include integrated circuits called system LSIs, very large-scale integrations (VLSIs), or ultra-large-scale integrations (ULSIs). Furthermore, field-programmable gate arrays (FPGAs), which are programmable after the LSI is manufactured, or logic devices capable of reconfiguring the connections within the LSI or the circuit partitions within the LSI, can also be used as processors. The electronic circuits may be integrated into one chip or distributed across multiple chips. The chips may be integrated into one device or distributed across multiple devices. The computer system referred to here includes a microcontroller having one or more processors and one or more memories. Therefore, the microcontroller is also composed of one or more electronic circuits including a semiconductor integrated circuit or a large-scale integrated circuit.

[0089] Furthermore, it is not essential for the information processing system 1 that multiple functions are integrated into one device, and multiple components of the information processing system 1 may be distributed across multiple devices. For example, a device including the image capturing unit 15 may be provided separately from a device including the display unit 14.

[0090] At least some of the functions of the information processing system 1, for example, the image processing function in the processing unit 11, may be realized by a server or the cloud (cloud computing), or the like.

[0091] (summary) As described above, the information processing system (1) of the first aspect includes a storage unit (12) and a display unit (14). The storage unit (12) stores a space map (A1) that is a diagram of a target space, shooting positions (A2) set on the space map (A1), and target information (A31) related to a target to be photographed at the shooting position (A2). The display unit (14) displays the space map (A1), markers (Mn, M1 to M4) corresponding to the shooting positions (A2), and the target information (A31). In an unphotographed state in which photography at the shooting position (A2) is not yet completed, the display unit (14) displays the space map (A1) with the markers (Mn, M1 to M4) superimposed at a first display position corresponding to the shooting position (A2) on the space map (A1) and the target information (A31) superimposed at a second display position corresponding to the first display position.

[0092] According to this aspect, the user can easily understand where and what kind of subject should be photographed.

[0093] In the information processing system (1) of the second aspect, the second display area (142) displaying the target information (A31) is smaller than the first display area (141) displaying the spatial map (A1) in the first aspect, and the second display area (142) is larger than the display size of the markers (Mn, M1 to M4).

[0094] According to this aspect, by making the second display area (142) larger than the display size of the markers (Mn, M1 to M4), the amount of information that can be displayed in the second display area (142) can be increased.

[0095] In the information processing system (1) of the third aspect, in the first or second aspect, in a photographed state in which a photographed image (A4) photographed at the photographing position (A2) exists, the display unit (14) displays a space diagram (A1) in which markers (Mn, M1 to M4) are superimposed at the first display position and the photographed image (A4) is superimposed at the second display position.

[0096] According to this aspect, in the photographed state, the photographed image (A4) is displayed at the second display position, so that the user can check the photographed image (A4) photographed at the photographing position (A2).

[0097] In the information processing system (1) of the fourth aspect, the third display area (143) for displaying the captured image (A4) is smaller than the first display area (141) for displaying the spatial map (A1) in the third aspect, and the third display area (143) is larger than the display size of the markers (Mn, M1 to M4).

[0098] According to this aspect, by making the third display area (143) larger than the display size of the markers (Mn, M1 to M4), the image size of the captured image (A4) displayed in the third display area (143) can be made larger.

[0099] In the information processing system (1) of the fifth aspect, in any of the first to fourth aspects, a plurality of photographing positions (A2) are set on a spatial map (A1). The plurality of photographing positions (A2) include unphotographed positions where photographing has not been completed and photographed positions where photographing has been completed. The display unit (14) displays markers (Mn, M1 to M4) at the unphotographed positions on the spatial map (A1) by superimposing them at first display positions corresponding to the unphotographed positions, and displays object information (A31) related to the photographed object to be photographed at the unphotographed positions by superimposing it at a second display position corresponding to the first display position corresponding to the unphotographed positions. The display unit (14) displays markers (Mn, M1 to M4) at the photographed positions on the spatial map (A1) by superimposing them at first display positions corresponding to the photographed positions, and displays a photographed image (A4) photographed at the photographed position by superimposing it at a second display position corresponding to the first display position corresponding to the photographed position.

[0100] According to this aspect, at an unphotographed position on the spatial map (A1), markers (Mn, M1 to M4) are displayed superimposed at the first display position, and target information (A31) is displayed superimposed at the second display position, so that the user can easily understand where and what kind of target to photograph. Also, at an photographed position on the spatial map (A1), markers (Mn, M1 to M4) are displayed superimposed at the first display position, and the photographed image (A4) is displayed superimposed at the second display position, so that the user can check the photographed image (A4) photographed at the photographed position.

[0101] In the information processing system (1) of the sixth aspect, in the fifth aspect, the storage unit (12) further stores sequence information (A32) indicating the sequence of taking images at the plurality of image taking positions (A2). The display unit (14) displays the sequence information (A32) in association with the markers (Mn, M1 to M4) at each of the plurality of first display positions.

[0102] According to this aspect, the user can easily understand the order in which to take photographs at the multiple photographing positions (A2).

[0103] The information processing system (1) of a seventh aspect is in any one of the first to sixth aspects, and further includes an operation unit (13) that accepts a user's operation to switch the display mode of the display unit (14) between a simple display mode and a detailed display mode. When the display mode of the display unit (14) is the detailed display mode, the display unit (14) displays, in an unphotographed state, a space map (A1) with markers (Mn, M1 to M4) superimposed at a first display position and target information (A31) superimposed at a second display position. When the display mode of the display unit (14) is the simple display mode, the display unit (14) displays the space map (A1) with markers (Mn, M1 to M4) superimposed at the first display position.

[0104] According to this aspect, the user can switch the display mode of the display unit 14 between the simple display mode and the detailed display mode. In the detailed display mode, the user can easily understand where and what kind of subject to photograph based on the subject information A31 displayed in the second display position.

[0105] In the information processing system (1) of the eighth aspect, when the display mode of the display unit (14) is the detailed display mode in the seventh aspect, the display unit (14) displays a spatial diagram (A1) in which markers (Mn, M1 to M4) are superimposed at the first display position and the captured image (A4) is superimposed at the second display position in a captured state in which a captured image (A4) captured at the capturing position (A2) exists.

[0106] According to this aspect, the user can switch the display mode of the display unit 14 between the simple display mode and the detailed display mode. In the detailed display mode, the user can check the captured image A4 captured at the capturing position A2 based on the captured image A4 displayed at the second display position.

[0107] A ninth aspect of the information processing method is an information processing method for an information processing system (1) including a storage unit (12) and a display unit (14), and includes a display step. The storage unit (12) stores a space map (A1) that is a diagram of a target space, shooting positions (A2) set on the space map (A1), and target information (A31) related to a target to be photographed at the shooting position (A2). The display unit (14) displays the space map (A1), markers (Mn, M1 to M4) corresponding to the shooting positions (A2), and the target information (A31). In the display step, in an unphotographed state where photography at the shooting position (A2) is not yet completed, the space map (A1) is displayed with the markers (Mn, M1 to M4) superimposed at a first display position corresponding to the shooting position (A2) and the target information (A31) superimposed at a second display position corresponding to the first display position.

[0108] According to this aspect, the user can easily understand where and what kind of subject should be photographed.

[0109] In a tenth aspect of the information processing method, in the ninth aspect, a plurality of photographing positions (A2) are set on a spatial map (A1), and the plurality of photographing positions (A2) include unphotographed positions where photographing has not been completed and photographed positions where photographing has been completed. In the display step, markers (Mn, M1 to M4) are superimposed at the unphotographed positions on the spatial map (A1) at first display positions corresponding to the unphotographed positions, and object information (A31) related to the object to be photographed at the unphotographed positions is superimposed and displayed at a second display position corresponding to the first display position corresponding to the unphotographed positions. In the display step, markers (Mn, M1 to M4) are superimposed at the photographed positions on the spatial map (A1) at first display positions corresponding to the photographed positions, and a photographed image (A4) photographed at the photographed position is superimposed and displayed at a second display position corresponding to the first display position corresponding to the photographed position.

[0110] According to this aspect, at an unphotographed position on the spatial map (A1), markers (Mn, M1 to M4) are displayed superimposed at the first display position, and target information (A31) is displayed superimposed at the second display position, so that the user can easily understand where and what kind of target to photograph. Also, at an photographed position on the spatial map (A1), markers (Mn, M1 to M4) are displayed superimposed at the first display position, and the photographed image (A4) is displayed superimposed at the second display position, so that the user can check the photographed image (A4) photographed at the photographing position.

[0111] A program according to an eleventh aspect is a program for causing one or more processors of a computer system to execute the information processing method according to the ninth or tenth aspect.

[0112] According to this aspect, the user can easily understand where and what kind of subject should be photographed.

[0113] Not limited to the above aspects, various configurations (including modified examples) of the information processing system (1) according to the embodiment can be embodied as an information processing method performed by the information processing system (1), a (computer) program, or a non-transitory recording medium on which a program is recorded, etc.

[0114] The configurations according to the second to eighth aspects are not essential for the information processing system 1 and may be omitted as appropriate. The configuration according to the tenth aspect is not essential for the information processing method and may be omitted as appropriate. [Explanation of symbols]

[0115] 1. Information Processing Systems 12 Storage section 13 Control section 14 Display section 141 1st display area 142 Second display area 143 Third display area A1 Space map A2 Shooting position A4 photo A31 Target Information A32 Sequence information Mn, M1~M4 markers

Claims

1. a storage unit that stores a space map that is a diagram of a target space, a shooting position set on the space map, and target information related to a target to be photographed at the shooting position; a display unit that displays the spatial map, markers corresponding to the photographing positions, and the target information; an operation unit that accepts a user's operation to switch the display mode of the display unit to either a simple display mode or a detailed display mode, The display unit When the display mode of the display unit is the detailed display mode, in an unphotographed state where photography at the photography position has not yet been completed, the marker is superimposed on a first display position on the space map corresponding to the photography position, and the space map is displayed with the target information superimposed on a second display position corresponding to the first display position; When the display mode of the display unit is the simple display mode, the space diagram is displayed with the marker superimposed on the first display position. Information processing system.

2. a second display area for displaying the target information is smaller than a first display area for displaying the spatial diagram, and the second display area is larger than a display size of the marker; The information processing system according to claim 1 .

3. When the display mode of the display unit is the detailed display mode, in a photographed state in which a photographed image taken at the photographing position exists, the display unit superimposes the marker at the first display position and displays the spatial diagram with the photographed image superimposed at the second display position. The information processing system according to claim 1 .

4. a third display area for displaying the captured image is smaller than a first display area for displaying the spatial diagram, and the third display area is larger than a display size of the marker; The information processing system according to claim 3 .

5. A plurality of the photographing positions are set on the spatial map, The plurality of photographing positions include unphotographed positions where photographing has not been completed and photographed positions where photographing has been completed, When the display mode of the display unit is the detailed display mode, At the unphotographed position on the spatial diagram, the marker is superimposed at the first display position corresponding to the unphotographed position, and the target information regarding the photographed target to be photographed at the unphotographed position is superimposed at the second display position corresponding to the first display position corresponding to the unphotographed position, and At the photographed position on the space map, the marker is superimposed at the first display position corresponding to the photographed position, and the photographed image photographed at the photographed position is superimposed and displayed at the second display position corresponding to the first display position corresponding to the photographed position. The information processing system according to claim 1 .

6. the storage unit further stores sequence information indicating a sequence of taking images at the plurality of imaging positions; the display unit displays the order information in association with the marker at each of the plurality of first display positions. The information processing system according to claim 5 .

7. A storage unit that stores a space map that is a diagram of a target space, a shooting position set on the space map, and target information regarding a target to be photographed at the shooting position; an information processing method for an information processing system including a display unit that displays the spatial map, a marker corresponding to the shooting position, and the target information, an operation receiving step of receiving a user's operation to switch the display mode of the display unit to either a simple display mode or a detailed display mode; a display step, In the display step, When the display mode of the display unit is the detailed display mode, in an unphotographed state where photography at the photography position has not yet been completed, the marker is superimposed on a first display position on the space map corresponding to the photography position, and the space map is displayed with the target information superimposed on a second display position corresponding to the first display position; When the display mode of the display unit is the simple display mode, the space diagram is displayed with the marker superimposed on the first display position. Information processing methods.

8. A plurality of the photographing positions are set on the spatial map, The plurality of photographing positions include unphotographed positions where photographing has not been completed and photographed positions where photographing has been completed, In the display step, when the display mode of the display unit is the detailed display mode, At the unphotographed position on the spatial diagram, the marker is superimposed at the first display position corresponding to the unphotographed position, and the target information regarding the photographed target to be photographed at the unphotographed position is superimposed at the second display position corresponding to the first display position corresponding to the unphotographed position, and At the photographed position on the space map, the marker is superimposed at the first display position corresponding to the photographed position, and the photographed image photographed at the photographed position is superimposed and displayed at the second display position corresponding to the first display position corresponding to the photographed position. The information processing method according to claim 7.

9. For causing one or more processors of a computer system to execute the information processing method according to claim 7 or 8, program.

Images