Construction management support device and construction management support system

Abstract

To provide a construction management support device that allows construction progress status of a structure to be easily grasped.SOLUTION: A construction management support device supports construction management of a structure. The construction management support device includes an image acquisition unit, an image combining unit, and a display control unit. The image acquisition unit acquires a plurality of aerial images captured from the air by an aircraft having an image capturing unit. In each aerial image, at least a portion of the structure is captured for each of a plurality of regions from a position where an image capturing direction by the image capturing unit is substantially vertical, and position information for each aerial image is recorded. The image combining unit generates a combined image by combining the plurality of aerial images based on the position information included in each aerial image. The display control unit displays the combined image.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The technology disclosed in this specification relates to a construction management support device and a construction management support system. [Background technology]

[0002] There is known a construction management support device that supports construction management of structures such as buildings and civil engineering structures. The construction management support device supports the construction management work of a construction manager by, for example, storing drawing data of the structure to be constructed and image data of the structure, and displaying the drawing data and image data. An example of the construction management work is to communicate the progress of the construction of the structure to the client or on-site workers.

[0003] Conventionally, a transmission system has been proposed for transmitting information to a client or the like by using a plurality of photographs taken as the construction progresses (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2001-227162 A Summary of the Invention [Problem to be solved by the invention]

[0005] In the above-mentioned communication system, the construction manager needs to go to the site to obtain multiple images and explain the progress status using multiple images in order to communicate the progress status of the construction of the structure to the client or the on-site worker. Meanwhile, the client or the on-site worker needs to check the multiple images one by one in order to understand the progress status of the construction. Therefore, the communication of the progress status of the construction by the above-mentioned communication system is a time-consuming task for all of the construction manager, the client, and the on-site worker.

[0006] This specification discloses a technique that can solve the above-mentioned problems. [Means for solving the problem]

[0007] The technology disclosed in this specification can be realized, for example, in the following forms.

[0008] (1) A construction management support device disclosed in this specification supports construction management of a structure. The construction management support device includes an image acquisition unit, an image synthesis unit, and a display control unit. The image acquisition unit acquires a plurality of aerial images photographed from the air by an aircraft having an image capture unit. Each of the aerial images is photographed for each of a plurality of regions of at least a portion of the structure from a position where the image capture direction by the image capture unit is approximately vertical, and position information of each of the aerial images is recorded. The image synthesis unit generates a composite image by synthesizing the plurality of aerial images based on the position information of each of the aerial images. The display control unit displays the composite image.

[0009] According to this construction management support device, a plurality of aerial photographed images of a structure to be constructed are acquired by an aircraft, and a composite image can be generated by synthesizing the plurality of aerial photographed images. That is, the construction manager does not need to go to the site to acquire a plurality of images or to explain the progress status using the plurality of images in order to communicate the progress status of the construction of the structure to the client or the on-site worker. The construction manager can acquire a composite image in which at least a portion of the structure is displayed by operating this construction management support device, and can explain the progress status using one composite image. Meanwhile, the client or the on-site worker can fully grasp the progress status of the construction by simply looking at one composite image. Therefore, according to this construction management support device, the effort required for the construction manager to communicate the progress status of the construction can be reduced.

[0010] In addition, according to the construction management support device, each aerial image is taken from a position where the shooting direction of the shooting unit is approximately vertical. Therefore, compared with an aerial image taken from an oblique direction, it is possible to reduce the position and size deviation caused by the difference in height of each point on the structure.

[0011] (2) In the above construction management support device, the composite image may be an image obtained by combining the multiple aerial photographs so that the entire site of the structure is captured in a single image. With this construction management support device, the owner or on-site worker can fully grasp the progress of the entire construction of the structure simply by looking at a single composite image that captures the entire site of the structure. This makes it possible to more effectively reduce the effort required for the construction manager to communicate the progress of the construction.

[0012] (3) In the above construction management support device, the location information of each of the aerial photographed images may include latitude and longitude information and altitude information of the aircraft at the time when each of the aerial photographed images was taken from the air. According to this construction management support device, a composite image can be generated based on the latitude and longitude information and altitude information for each aerial photographed image. Therefore, the accuracy of the composite image can be improved, and the construction manager can accurately communicate the progress of the construction work.

[0013] (4) In the above construction management support device, the longitude and latitude information may be obtained by the flying object receiving a signal from a global positioning satellite system. According to this construction management support device, the longitude and latitude information for each aerial photograph can be obtained from the global positioning satellite system, and a composite image can be generated based on the obtained longitude and latitude information. Therefore, the accuracy of the composite image can be more effectively improved, and the construction manager can more accurately communicate the progress of the construction.

[0014] (5) The above construction management support device may further include a flight program instruction unit, the display control unit displays map information data including the longitude and latitude information, and the flight program instruction unit sets a flight path for the aircraft to take aerial photographs based on the flight range of the aircraft specified on the map information data, and transmits a flight program including the flight path to the aircraft. According to this construction management support device, the flight path of the aircraft can be set based on the flight range of the aircraft specified by the construction manager on the map information data, and a flight program including the flight path can be transmitted to the aircraft. Therefore, the effort required for the construction manager to communicate the progress of the construction can be more effectively reduced.

[0015] (6) In the above construction management support device, the flight program instruction unit may set a shooting position for the photographing unit when the aircraft takes an aerial photograph based on the flight range of the aircraft specified on the map information data, and the flight program may include the shooting position. According to this construction management support device, the shooting position for the photographing unit can be set based on the flight range of the aircraft specified by the construction manager on the map information data, and the flight program including the shooting position can be transmitted to the aircraft. Therefore, the effort required for the construction manager to communicate the progress of the construction can be more effectively reduced.

[0016] (7) The above construction management support device may further include an image processing unit that draws, on the composite image, a display showing the position of the grid line of the structure on the composite image. According to this construction management support device, a display showing the position of the grid line of the structure can be drawn on the composite image. Therefore, the work required for the construction manager to communicate the progress of the construction can be more effectively reduced.

[0017] (8) In the above construction management support device, the image processing unit may be configured to draw an indication showing the work status for each of a plurality of work areas in the construction of the structure. According to this construction management support device, an indication showing the work status for each of a plurality of work areas can be drawn on a composite image. Therefore, the effort required for the construction manager to communicate the progress of the construction can be more effectively reduced.

[0018] (9) The above construction management support device may further include an image analysis unit that automatically recognizes at least one of the position of the grid line on the composite image of the structure and the work status for each of the multiple work areas in the construction of the structure by analyzing the composite image, and the image processing unit may automatically draw a display showing at least one of the position of the grid line in the structure and the work status for each of the multiple work areas based on the analysis of the image analysis unit. According to this construction management support device, the position of the grid line in the structure and the work status for each of the multiple work areas can be automatically recognized by image analysis, and the position of the grid line and the work status can be automatically drawn on the composite image. Therefore, the effort required for the construction manager to communicate the progress of the construction can be more effectively reduced.

[0019] (10) A construction management support system disclosed in this specification supports construction management of a structure. The construction management support system includes an aircraft and a terminal device. The aircraft has an image capturing unit that captures a plurality of aerial images, a satellite signal receiving unit that receives a signal from a global positioning satellite system to capture position information of the aircraft at the time each of the aerial images was captured, an aircraft control unit that records the position information of the aircraft captured by the satellite signal receiving unit in each of the aerial images, and an aircraft side communication unit that transmits the plurality of aerial images to the terminal device. The terminal device has a terminal device side communication unit that receives the plurality of aerial images from the aircraft, an image capture unit that captures the plurality of aerial images via the terminal device side communication unit, an image composition unit that generates a composite image by combining the plurality of aerial images based on the position information of each of the aerial images, and a display control unit that displays the composite image.

[0020] According to this construction management support system, a plurality of aerial photographs of a structure to be constructed are acquired by an aircraft, and a composite image can be generated by synthesizing the plurality of aerial photographs. That is, the construction manager does not need to go to the site to acquire a plurality of images or to explain the progress status using the plurality of images in order to communicate the progress status of the construction of the structure to the client or the on-site worker. The construction manager can acquire a composite image in which at least a portion of the structure is displayed by operating a terminal device, and can explain the progress status using one composite image. Meanwhile, the client or the on-site worker can fully grasp the progress status of the construction by simply looking at one composite image. Therefore, according to this construction management support system, the effort required for the construction manager to communicate the progress status of the construction can be reduced.

[0021] The technology disclosed in this specification can be realized in various forms, such as a construction management support device, a construction management support system, a construction management support method, a computer program for realizing the functions of those devices or systems, and a non-transitory recording medium on which that computer program is recorded. [Brief description of the drawings]

[0022] [Figure 1] A block diagram showing the configuration of a construction management support system 10 according to the present embodiment. [Diagram 2] A flowchart showing the construction management support process in this embodiment. [Diagram 3] FIG. 1 is an explanatory diagram showing an example of map information data MD. [Figure 4] FIG. 1 is an explanatory diagram showing an example of a method for acquiring an aerial image AP by an aircraft 300. [Diagram 5] FIG. 13 is an explanatory diagram showing an example of a composite image CP after image processing. [Figure 6] FIG. 13 is an explanatory diagram showing an example of a progress management screen PS. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] A. Embodiment: A-1. Configuration of construction management support system 10: FIG. 1 is a block diagram showing the configuration of a construction management support system 10 in this embodiment. The construction management support system 10 is for supporting management of construction of structures such as buildings and civil engineering structures, and includes a server device 100, a terminal device 200, and an aircraft 300. The server device 100, the terminal device 200, and the aircraft 300 are connected to each other via a network NW. Although one terminal device 200 is shown in FIG. 1, the number of terminal devices 200 included in the construction management support system 10 may be two or more. The terminal device 200 is an example of a construction management support device in the claims.

[0024] The server device 100 is a device for managing the construction of a structure, and includes a control unit 110, a storage unit 120, a communication unit 130, an operation unit 140, and a display unit 150. The storage unit 120 is configured, for example, by a hard disk drive (hereinafter referred to as "HDD"), a ROM, a RAM, etc., and stores a program for controlling the server device 100. The control unit 110 is configured, for example, by a central control unit (hereinafter referred to as "CPU"), etc., and controls each part of the server device 100 according to a program read from the storage unit 120. The communication unit 130 is an interface that communicates with an external device by a wireless communication method or a wired communication method. The operation unit 140 is configured, for example, by a keyboard, a mouse, etc., and accepts operations by a construction manager. The display unit 150 is configured, for example, by a liquid crystal display, etc., and displays drawings, image data, etc.

[0025] The terminal device 200 is a device used by a construction manager, and is, for example, a tablet terminal, a smartphone, a wearable device such as an HMD (head mounted display), and includes a control unit 210, a storage unit 220, a communication unit 230, a display unit 240, and a satellite signal receiving unit 250. The storage unit 220 is, for example, configured with a HDD, a ROM, a RAM, etc., and stores various programs for controlling the terminal device 200. The communication unit 230 is an interface that communicates with an external device by a wireless communication method or a wired communication method. The display unit 240 is, for example, configured with a liquid crystal display, etc., and displays various images and information. The communication unit 230 is an example of a terminal device side communication unit in the claims.

[0026] The satellite signal receiving unit 250 is a device that acquires information (latitude and longitude) for identifying its own current position by using a signal received from a satellite 20 constituting a GNSS (Global Navigation Satellite System) such as a GPS (Global Positioning System). The GNSS used in this embodiment may employ single positioning using one receiver like GPS, or may employ relative positioning using two or more receivers like RTK (Real Time Kinematic)-GNSS. The satellite 20 is an example of a global positioning satellite system in the claims.

[0027] The control unit 210 is configured with, for example, a CPU, and executes various programs read from the storage unit 220. This realizes each function of the control unit 210, such as an image acquisition unit 211, an image synthesis unit 212, a display control unit 213, a flight program instruction unit 214, an image processing unit 215, and an image analysis unit 216. Each of these functions will be described later in "A-2. Construction management support processing."

[0028] The aircraft 300 is, for example, a UAV (Unmanned Aerial Vehicle) such as a drone. In the construction management support system 10, the aircraft 300 takes an aerial photograph of a structure. The aircraft 300 includes a control unit 310, a memory unit 320, a rotary wing mechanism 330, an image capturing unit 340, a gimbal 350, a satellite signal receiving unit 360, a barometric pressure measuring unit 370, a geomagnetic sensor 380, and a communication unit 390.

[0029] The storage unit 320 is composed of, for example, a HDD, a ROM, a RAM, etc., and stores various programs for controlling the flying object 300. The control unit 310 is composed of, for example, a CPU, etc., and executes the programs read from the storage unit 320. The rotor mechanism 330 includes at least one rotor and at least one motor for rotating the rotor, and generates lift and thrust for the flying object 300 by the rotation of the rotor. The photographing unit 340 is, for example, a camera. The gimbal 350 is located below the flying object 300 and has at least one rotation shaft having a rotation axis line extending in the horizontal direction. The gimbal 350 supports the photographing unit 340 by the rotation shaft, and changes the photographing direction of the photographing unit 340 by the rotation of the rotation shaft. The satellite signal receiving unit 360 is a device that acquires information (latitude and longitude) for identifying its own current position using a signal received from a satellite 20 constituting a GNSS such as GPS or RTK-GNSS. The air pressure measurement unit 370 detects the altitude of the flying object 300 by measuring the air pressure. The geomagnetic sensor 380 is a sensor that detects the magnetic force of the earth and detects the direction of the nose of the flying object 300. The communication unit 390 is an interface that communicates with an external device by a wireless communication method. The communication unit 390 is an example of an air vehicle side communication unit in the claims.

[0030] A-2. Construction management support processing: Next, the construction management support process executed by the terminal device 200 will be described. Fig. 2 is a flowchart showing the construction management support process in this embodiment. The construction management support process is a process for supporting the construction management work of a construction manager by displaying drawings and images. The construction management support process is started, for example, when a start instruction is given by the construction manager via the operation reception unit of the terminal device 200.

[0031] First, a flight program for the aircraft 300 is set using the terminal device 200 (S110).

[0032] The construction manager sets a flight program for the flying object 300 using the terminal device 200. The flying object 300 flies based on the flight program set by the construction manager using the terminal device 200, and acquires multiple aerial images AP (see FIG. 5). The flight program includes a flight path FC, a shooting position, a flight altitude, and a shooting direction FD. The flight path FC and the shooting position are set by the flight program instruction unit 214 based on the flight range FR and the overlap rate specified by the construction manager via the operation reception unit. The flight altitude and the shooting direction FD are directly set by the construction manager via the operation reception unit.

[0033] The flight path FC is the flight path of the flying object 300 when the flying object 300 takes an aerial photograph of a structure. The photographing position is the photographing position by the photographing unit 340 when the flying object 300 takes an aerial photograph of a structure. The flight altitude is the altitude of the flying object 300 when the flying object 300 takes an aerial photograph of a structure. The photographing direction FD, which will be described in detail later, is the photographing angle by the photographing unit 340 when the flying object 300 takes an aerial photograph.

[0034] The flight range FR is the range in which aerial photography is performed by the flying object 300. A method for setting the flight range FR will be described later. The overlap ratio means the overlap ratio between an aerial photographed image at an arbitrary position during aerial photography by the flying object 300 and another aerial photographed image adjacent to the aerial photographed image at the arbitrary position. The overlap ratio correlates with the accuracy of a composite image CP (see FIG. 5) generated by combining a plurality of aerial photographed images AP; an increase in the overlap ratio increases the accuracy of the composite image CP, and a decrease in the overlap ratio decreases the accuracy of the composite image CP. A method for setting a flight program will be described in detail below.

[0035] FIG. 3 is an explanatory diagram showing an example of map information data MD. First, the construction manager specifies the flight range FR using the map information data MD as shown in FIG. 3. For example, an open source map application available on the network NW can be used as the map information data MD. The map information data MD includes latitude and longitude information indicating the latitude and longitude of each point displayed on the map information data MD. The control unit 210 acquires the map information data MD in advance from the map application available on the network NW via the communication unit 230, and stores the map information data MD in the storage unit 220.

[0036] The control unit 210 causes the display unit 240 to display the map information data MD stored in the storage unit 220. The construction manager specifies the flight range FR using the map information data MD displayed on the display unit 240. The construction manager specifies, for example, via the operation reception unit, on the map information data MD a takeoff point Sp, a landing point Ep, and a waypoint Vp from the takeoff point Sp to the landing point Ep when the flying object 300 takes an aerial photograph of a structure. The flight program instruction unit 214 specifies the flight range FR based on the takeoff point Sp, the landing point Ep, and the waypoint Vp specified by the construction manager. In addition to specifying the flight range FR, the construction manager specifies a lap rate via the operation reception unit.

[0037] The flight program instruction unit 214 sets the flight path FC and the photographing position based on the flight range FR and the overlap rate specified by the construction manager. In detail, the flight program instruction unit 214 sets an appropriate flight path FC so that the overlap rate set by the construction manager is satisfied when the aircraft 300 flies from the takeoff point Sp to the landing point Ep. In addition, the flight program instruction unit 214 sets an appropriate photographing position so that the overlap rate set by the construction manager is satisfied when the aircraft 300 flies on the flight path FC. Through the above operations, the flight path FC and the photographing position of the flight program are set.

[0038] Following the setting of the flight route FC and the photographing position, the construction manager inputs the flight altitude and the photographing direction FD via the operation reception unit. This completes the setting of the flight program including the flight route FC, the photographing position, the flight altitude, and the photographing direction FD.

[0039] The flight program instruction unit 214 of the control unit 210 transmits the flight program set by the construction manager to the flying object 300 via the communication unit 230. When the control unit 310 of the flying object 300 receives the flight program transmitted from the terminal device 200 via the communication unit 390, it stores the received flight program in the memory unit 320.

[0040] Next, a plurality of aerial images AP are acquired by photographing a plurality of regions of the entire site 32 of the structure 30 from the air by the aircraft 300 (S120).

[0041] The flying object 300 executes a flight program when, for example, a construction manager issues a flight start instruction via an operation reception unit of the terminal device 200. The control unit 310 executes the flight program of the flying object 300 by controlling the operation of the rotary wing mechanism 330 and the like. The flying object 300 acquires a plurality of aerial images AP based on instructions from the control unit 310.

[0042] The control unit 310 receives longitude and latitude information of the flying object 300 from the satellite 20 via the satellite signal receiving unit 360. The control unit 310 controls the operation of the rotary wing mechanism 330 based on the received longitude and latitude information so that the flying object 300 can fly on the flight path FC set by the construction manager. The control unit 310 controls the photographing unit 340 based on the received longitude and latitude information so that the flying object 300 can acquire the aerial image AP when it reaches the photographing position. The control unit 310 detects altitude information of the flying object 300 via the air pressure measuring unit 370. The control unit 310 controls the operation of the rotary wing mechanism 330 based on the detected altitude information so that the flying object 300 can maintain the flight altitude set by the construction manager. The control unit 310 controls the rotation axis of the gimbal 350 so that the flying object 300 maintains the photographing direction FD set by the construction manager.

[0043] FIG. 4 is an explanatory diagram showing an example of a method of acquiring an aerial image AP by an aircraft 300. In this embodiment, each aerial image AP is captured from a position where the shooting direction FD by the image capture unit 340 is approximately vertical. "Captured from a position where the shooting direction FD is approximately vertical" refers to capturing images from a direction where the optical axis OA of the lens 342 included in the image capture unit 340 is approximately perpendicular to the ground surface GR. "Approximately perpendicular" includes not only a state where the optical axis OA and the ground surface GR are 90 degrees, but also a state where the optical axis OA and the ground surface GR are 90±5 degrees, for example. As described above, the control unit 310 controls the rotation axis of the gimbal 350 based on the shooting direction FD input by the construction manager via the operation reception unit, and adjusts the shooting direction FD by the image capture unit 340.

[0044] Each aerial image AP acquired in this manner has location information recorded therein. The location information includes longitude and latitude information and altitude information of the flying object 300 at the time each aerial image AP was captured. The longitude and latitude information is acquired by receiving the longitude and latitude information of the flying object 300 at the time each aerial image AP was captured from the satellite 20 via the satellite signal receiving unit 360. The altitude information is acquired by the air pressure measuring unit 370. The control unit 310 records the longitude and latitude information and the altitude information in each aerial image AP.

[0045] The control unit 310 stores the multiple aerial images AP acquired by the photographing unit 340 based on the flight program in the memory unit 320. The control unit 310 transmits the multiple aerial images AP stored in the memory unit 320 to the server device 100 via the communication unit 390. The control unit 110 of the server device 100 receives the multiple aerial images AP via the communication unit 130 and stores them in the memory unit 120.

[0046] Next, the plurality of aerial images AP are composited to generate a composite image CP (S130).

[0047] The control unit 110 of the server device 100 transmits a plurality of aerial images AP to the terminal device 200 via the communication unit 130. The image acquisition unit 211 of the control unit 210 receives the aerial images AP via the communication unit 230 and stores them in the storage unit 220.

[0048] The image synthesis unit 212 generates a composite image CP by synthesizing a plurality of aerial images AP stored in the memory unit 220 (see FIG. 5). The synthesis of a plurality of aerial images AP is performed based on the position information (i.e., longitude and latitude information and altitude information) possessed by each aerial image AP. The composite image CP can be generated, for example, by the method disclosed in JP 2019-28560 A. The composite image CP is generated by synthesizing a plurality of aerial images AP so that the site 32 of the structure 30 fits into one image. After the generation of the composite image CP is completed, the control unit 210 stores the composite image CP in the memory unit 220.

[0049] Next, image analysis of the composite image CP is performed to recognize the position of the grid line AS on the composite image CP of the structure 30 and the work status WS for each of a plurality of work areas WA in the construction of the structure 30 (S140).

[0050] The image analysis unit 216 of the control unit 210 recognizes the position of the grid AS on the composite image CP based on the longitude and latitude information recorded in each aerial photographed image AP. The image analysis unit 216 also recognizes the work status WS for each of the multiple work areas WA in the construction of the structure 30 (see FIG. 5). These image analyses can be realized by using a known image recognition technique, such as statistical pattern recognition based on image features. Note that artificial intelligence (AI) may be used for the image recognition. In this way, the accuracy of the image recognition can be improved.

[0051] Next, an indication indicating the position of the grid line AS and an indication indicating the work state WS are drawn on the composite image CP (S150).

[0052] 5 is an explanatory diagram showing an example of a composite image CP after image processing. The image processing unit 215 of the control unit 210 automatically draws, in the composite image CP, an indication (e.g., XB1, XB2, ..., etc.) indicating the grid line AS at the position of the grid line AS in the composite image CP recognized by the image analysis unit 216. In addition, the image processing unit 215 automatically draws, in the composite image CP, an indication (e.g., steel frame work, foundation work, etc.) indicating the work status WS of multiple work areas WA in the construction of the structure 30 recognized by the image analysis unit 216.

[0053] Next, the progress management screen PS is generated and displayed (S160).

[0054] FIG. 6 is an explanatory diagram showing an example of the progress management screen PS. FIG. 6 shows the progress management screen PS displayed on the display unit 240 of the terminal device 200. The progress management screen PS includes a header area PU and a progress status display area PM. The header area PU is an area that displays the name of the structure to be constructed (e.g., XXX Logistics Center) and the information displayed in the progress status display area PM (e.g., on-site construction status). The progress status display area PM includes an image display field PP that displays the composite image CP after processing by the image processing unit 215, and a date display field PD that displays the photographing date of the composite image CP displayed in the image display field PP. With the above, the construction management support process is completed.

[0055] A-3. Advantages of this embodiment: As described above, the terminal device 200 of this embodiment supports construction management of the structure 30. The terminal device 200 includes an image acquisition unit 211, an image synthesis unit 212, and a display control unit 213. The image acquisition unit 211 acquires a plurality of aerial images AP photographed from the air by the flying object 300 having the photographing unit 340. In each aerial image AP, at least a portion of the structure 30 is photographed for each of a plurality of regions from a position where the photographing direction FD of the photographing unit 340 is substantially vertical, and position information of each aerial image AP is recorded. The image synthesis unit 212 generates a composite image CP by synthesizing the aerial images AP based on the position information of each aerial image AP. The display control unit 213 displays the composite image CP.

[0056] In this way, according to the terminal device 200 of the present embodiment, a plurality of aerial photographed images AP of the structure 30, which is the construction target, are acquired by the flying object 300, and the plurality of aerial photographed images AP are synthesized to generate a composite image CP. That is, in order to communicate the progress of the construction of the structure 30 to the owner or the on-site worker, the construction manager does not need to go to the site to acquire a plurality of images or to explain the progress using the plurality of images. The construction manager can acquire a composite image CP in which at least a portion of the structure 30 is displayed by operating the terminal device 200, and can explain the progress using one composite image CP. Meanwhile, the owner or the on-site worker can fully grasp the progress of the construction just by looking at one composite image CP. Therefore, according to the terminal device 200, the work required for the construction manager to communicate the progress of the construction can be reduced.

[0057] Moreover, according to the terminal device 200 of this embodiment, each aerial image AP is captured from a position where the capturing direction FD of the image capturing unit 340 is substantially vertical. Therefore, compared with an aerial image captured from an oblique direction, it is possible to reduce deviations in position and size caused by differences in height of each point on a structure.

[0058] Furthermore, in the terminal device 200 of this embodiment, the composite image CP is an image in which a plurality of aerial photographed images AP are composited so that the entire site 32 of the structure 30 fits in a single image. According to the terminal device 200 of this embodiment, the owner or on-site worker can fully grasp the overall progress of the construction of the structure 30 simply by looking at a single composite image CP that includes the entire site 32 of the structure 30. This makes it possible to more effectively reduce the effort required for the construction manager to communicate the progress of the construction.

[0059] Furthermore, in the terminal device 200 of this embodiment, the position information of each aerial image AP includes longitude and latitude information and altitude information of the flying object 300 at the time when each aerial image AP was photographed from the air. According to the terminal device 200 of this embodiment, a composite image CP can be generated based on the longitude and latitude information and altitude information of each aerial image AP. Therefore, the accuracy of the composite image CP can be improved, and the construction manager can accurately communicate the progress of the construction work.

[0060] Furthermore, in the terminal device 200 of this embodiment, the longitude and latitude information is acquired by the flying object 300 receiving a signal from the satellite 20. According to the terminal device 200 of this embodiment, the longitude and latitude information of each aerial photographed image AP is acquired from the satellite 20, and a composite image CP can be generated based on the acquired longitude and latitude information. Therefore, the accuracy of the composite image CP can be more effectively improved, and the construction manager can more accurately communicate the progress of the construction work.

[0061] In addition, the terminal device 200 of this embodiment further includes a flight program instruction unit 214, and the display control unit 213 displays map information data MD including longitude and latitude information, and the flight program instruction unit 214 sets a flight path FC for the flying object 300 to perform aerial photography based on the flight range FR of the flying object 300 specified on the map information data MD, and transmits a flight program including the flight path FC to the flying object 300. According to the terminal device 200 of this embodiment, the flight path FC of the flying object 300 can be set based on the flight range FR of the flying object 300 specified by the construction manager on the map information data MD, and a flight program including the flight path FC can be transmitted to the flying object 300. Therefore, the effort required for the construction manager to communicate the progress of the construction can be more effectively reduced.

[0062] In addition, in the terminal device 200 of this embodiment, the flight program instruction unit 214 sets the shooting position by the photographing unit 340 when the flying object 300 takes an aerial photograph based on the flight range FR of the flying object 300 specified on the map information data MD, and the flight program includes the shooting position. According to the terminal device 200 of this embodiment, the construction manager can set the shooting position by the photographing unit 340 based on the flight range FR of the flying object 300 specified on the map information data MD, and transmit the flight program including the shooting position to the flying object 300. Therefore, the work required for the construction manager to communicate the progress of the construction can be more effectively reduced.

[0063] Moreover, the terminal device 200 of this embodiment further includes an image processing unit 215 that draws, on the composite image CP, an indication indicating the position of the grid line AS on the composite image CP in the structure 30. According to the terminal device 200 of this embodiment, it is possible to draw, on the composite image CP, an indication indicating the position of the grid line AS in the structure 30. Therefore, it is possible to more effectively reduce the effort required for the construction manager to communicate the progress of the construction work.

[0064] Furthermore, in the terminal device 200 of this embodiment, the image processing unit 215 draws an indication showing the work status WS for each of the multiple work areas WA in the construction of the structure 30. According to the terminal device 200 of this embodiment, an indication showing the work status WS for each of the multiple work areas WA can be drawn on the composite image CP. Therefore, the effort required for the construction manager to communicate the progress of the construction can be more effectively reduced.

[0065] In addition, the terminal device 200 of this embodiment further includes an image analysis unit 216 that automatically recognizes at least one of the position of the grid AS on the composite image CP of the structure 30 and the work state WS for each of the multiple work areas WA in the construction of the structure 30 by analyzing the composite image CP, and the image processing unit 215 automatically draws a display showing at least one of the position of the grid AS in the structure 30 and the work state WS for each of the multiple work areas WA based on the analysis of the image analysis unit 216. According to the terminal device 200 of this embodiment, the position of the grid AS in the structure 30 and the work state WS for each of the multiple work areas WA can be automatically recognized by image analysis, and further, the position of the grid AS and the work state WS can be automatically drawn on the composite image CP. Therefore, the effort required for the construction manager to communicate the progress of the construction can be more effectively reduced.

[0066] Moreover, the construction management support system 10 of this embodiment supports construction management of a structure 30. The construction management support system 10 includes an aircraft 300 and a terminal device 200. The aircraft 300 includes an image capture unit 340 that acquires a plurality of aerial images AP, a satellite signal receiving unit 360 that receives a signal from a satellite 20 to acquire position information of the aircraft 300 at the time each aerial image AP was captured, a control unit 310 that records the position information of the aircraft 300 acquired by the satellite signal receiving unit 360 in each aerial image AP, and a communication unit 390 that transmits the plurality of aerial images AP to the terminal device 200. The terminal device 200 has a communication unit 230 that receives multiple aerial images AP from the flying object 300, an image acquisition unit 211 that acquires the multiple aerial images AP via the communication unit 230, an image synthesis unit 212 that generates a composite image CP by synthesizing the multiple aerial images AP based on the position information of each aerial image AP, and a display control unit 213 that displays the composite image CP.

[0067] In this way, according to the construction management support system 10 of the present embodiment, a plurality of aerial photographed images AP of the structure 30, which is the construction target, are acquired by the flying object 300, and the plurality of aerial photographed images AP are synthesized to generate a composite image CP. That is, in order to communicate the progress of the construction of the structure 30 to the owner or the on-site worker, the construction manager does not need to go to the site to acquire a plurality of images or to explain the progress using the plurality of images. The construction manager can acquire a composite image CP in which at least a portion of the structure 30 is displayed by operating the terminal device 200, and can explain the progress using one composite image CP. Meanwhile, the owner or the on-site worker can fully grasp the progress of the construction just by looking at one composite image CP. Therefore, according to the construction management support system 10, the work required for the construction manager to communicate the progress of the construction can be reduced.

[0068] B. Variations: The technology disclosed in this specification is not limited to the above-described embodiments, and can be modified in various forms without departing from the spirit of the invention. For example, the following modifications are also possible.

[0069] The configuration of the construction management support system 10 in the above embodiment is merely an example, and various modifications are possible. For example, a transmitter (controller) for operating the flying object 300 may be provided.

[0070] The configuration of the terminal device 200 in the above embodiment is merely an example, and various modifications are possible. For example, the terminal device 200 may include a photographing unit or the like.

[0071] The configuration of the flying object 300 in the above embodiment is merely an example, and various modifications are possible. For example, the flying object 300 may be provided with an ultrasonic sensor for measuring the altitude of the flying object 300, an acceleration sensor for adjusting the attitude of the flying object 300 during flight, an angular velocity sensor, etc.

[0072] In the above embodiment, the multiple aerial images AP acquired by the image capture unit 340 are transmitted from the flying object 300 to the server device 100, and then transmitted from the server device 100 to the terminal device 200, but the multiple aerial images AP may be transmitted directly from the flying object 300 to the terminal device 200 without going through the server device 100. In such a case, the server device 100 is not necessarily required.

[0073] In the construction management support system 10 of the above embodiment, the aircraft 300 photographs the entire site 32 of the structure 30 from the air, but the aircraft 300 may also photograph at least a portion of the site 32 of the structure 30 from the air.

[0074] In the above embodiment, the display showing the grid line AS and the work state WS is automatically drawn by the image processing unit 215, but the display showing the grid line AS and the work state WS may also be drawn by the construction manager.

[0075] In the above embodiment, the image analysis unit 216 recognizes the grid line AS and the working state WS on the composite image CP by image analysis, but may recognize either the grid line AS or the working state WS. Also, the image processing unit 215 draws the grid line AS and the working state WS on the composite image CP, but may draw either the grid line AS or the working state WS. [Explanation of symbols]

[0076] 10: Construction management support system 20: Satellite 30: Structure 32: Site 100: Server device 110: Control unit 120: Memory unit 130: Communication unit 140: Operation unit 150: Display unit 200: Terminal device 210: Control unit 211: Image acquisition unit 212: Image synthesis unit 213: Display control unit 214: Flight program instruction unit 215: Image processing unit 216: Image analysis unit 220: Memory unit 230: Communication unit 240: Display unit 250: Satellite signal receiving unit 300: Aircraft 310: Control unit 320: Memory unit 330: Rotary wing mechanism 340: Shooting unit 342: Lens 350: Gimbal 360: Satellite signal receiving unit 370: Atmospheric pressure measurement unit 380: Geomagnetic sensor 390: Communication unit NW: Network GR: Earth's surface OA: Optical axis AP: Aerial image CP: Composite image AS: Grid line WA: Work area FC: Flight route FD: Shooting direction FR: Flight range MD: Map information data Ep: Landing point Sp: Takeoff point Vp: Waypoint PS: Progress management screen PU: Header area PM: Progress display area PD: Date display field PP: Image display field

Claims

1. A construction management support device for supporting construction management of a structure, An image acquisition unit that acquires a plurality of aerial images taken from the air by an aircraft having an image capture unit, wherein each of the aerial images is captured by capturing at least a portion of the structure for each of a plurality of regions from a position where the image capture direction by the image capture unit is substantially vertical, and position information of each of the aerial images is recorded; an image synthesis unit that generates a synthetic image by synthesizing the plurality of aerial images based on the position information of each of the aerial images; A construction management support device comprising: a display control unit that displays the composite image.

2. The construction management support device according to claim 1, The composite image is an image obtained by combining the multiple aerial images so that the entire site of the structure fits into a single image, according to the construction management support device.

3. The construction management support device according to claim 2, A construction management support device in which the location information of each of the aerial images includes longitude and latitude information and altitude information of the aircraft at the time each of the aerial images was taken from the air.

4. The construction management support device according to claim 3, The construction management support device, wherein the longitude and latitude information is obtained by the aircraft receiving signals from a global positioning satellite system.

5. The construction management support device according to claim 4, further comprising: A flight program instruction unit is provided, the display control unit displays map information data including the latitude and longitude information, The flight program instruction unit sets a flight path for the aircraft to take aerial photography based on the flight range of the aircraft specified on the map information data, and transmits a flight program including the flight path to the aircraft. Construction management support device.

6. The construction management support device according to claim 5, The flight program instruction unit sets a photographing position by the photographing unit when the aircraft takes an aerial photograph based on a flight range of the aircraft specified on the map information data, The flight program includes the shooting position, and the construction management support device.

7. The construction management support device according to any one of claims 1 to 6, further comprising: A construction management support device comprising an image processing unit that draws on the composite image an indication indicating the position of a grid line on the composite image of the structure.

8. The construction management support device according to claim 7, The image processing unit is a construction management support device that draws an indication showing the work status for each of multiple work areas in the construction of the structure.

9. The construction management support device according to claim 8, further comprising: An image analysis unit that automatically recognizes at least one of the position of the grid line on the composite image of the structure and the work status for each of the plurality of work areas in the construction of the structure by analyzing the composite image, The image processing unit automatically draws a display indicating at least one of the position of the grid line in the structure and the work status based on the analysis of the image analysis unit, in a construction management support device.

10. A construction management support system for supporting construction management of a structure, The aircraft, A terminal device, The flying object is An imaging unit for acquiring a plurality of aerial images; a satellite signal receiving unit that receives signals from a global positioning satellite system to obtain position information of the aircraft at the time each of the aerial images was captured; a control unit that records the position information of the flying object acquired by the satellite signal receiving unit in each of the aerial images; an aircraft communication unit that transmits the plurality of aerial photographed images to the terminal device; having The terminal device A terminal device communication unit that receives the plurality of aerial photographed images from the aircraft; an image acquisition unit that acquires the plurality of aerial images via the terminal device side communication unit; an image synthesis unit that generates a synthetic image by synthesizing the plurality of aerial images based on the position information of each of the aerial images; A display control unit that displays the composite image; A construction management support system that has the following features:

Images